-- Logs begin at Tue 2022-08-02 09:25:21 UTC, end at Tue 2022-08-02 10:40:46 UTC. -- Aug 02 10:06:53.799800 dv-cinder-847132-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 10:06:53.812119 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 10:06:53 2022] *** Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: nodename: dv-cinder-847132-4-iscsi Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: machine: x86_64 Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: clock source: unix Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: pcre jit disabled Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: detected number of CPU cores: 4 Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: current working directory: / Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: detected binary path: /usr/bin/uwsgi-core Aug 02 10:06:53.814157 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: your processes number limit is 47680 Aug 02 10:06:53.816109 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: your memory page size is 4096 bytes Aug 02 10:06:53.816109 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: detected max file descriptor number: 2048 Aug 02 10:06:53.816109 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: lock engine: pthread robust mutexes Aug 02 10:06:53.816109 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: thunder lock: enabled Aug 02 10:06:53.816109 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 10:06:53.816109 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 10:06:53.854271 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: Python main interpreter initialized at 0x56140286c9c0 Aug 02 10:06:53.854271 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: python threads support enabled Aug 02 10:06:53.854455 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: your server socket listen backlog is limited to 100 connections Aug 02 10:06:53.854455 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: your mercy for graceful operations on workers is 90 seconds Aug 02 10:06:53.854621 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 10:06:53.854728 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: *** Operational MODE: preforking *** Aug 02 10:06:53.855018 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: *** uWSGI is running in multiple interpreter mode *** Aug 02 10:06:53.855018 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: spawned uWSGI master process (pid: 103433) Aug 02 10:06:53.855231 dv-cinder-847132-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 10:06:53.855955 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: spawned uWSGI worker 1 (pid: 103434, cores: 1) Aug 02 10:06:53.856680 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: spawned uWSGI worker 2 (pid: 103435, cores: 1) Aug 02 10:06:53.856680 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 10:06:54.543530 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:06:54.568099 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:06:55.659230 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:06:55.659230 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: from cryptography.utils import int_from_bytes Aug 02 10:06:55.659869 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:06:55.659869 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: from cryptography.utils import int_from_bytes Aug 02 10:06:55.681986 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:06:55.681986 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: from cryptography.utils import int_from_bytes Aug 02 10:06:55.682651 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:06:55.682651 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: from cryptography.utils import int_from_bytes Aug 02 10:06:58.342446 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:06:58.343046 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:06:58.343227 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:06:58.343590 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:06:58.343844 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:06:58.344232 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.344555 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.344880 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.345192 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.345522 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.345867 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.346194 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.346508 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.346835 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.347096 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.347410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.347733 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-4-iscsi {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.347894 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:06:58.348260 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.348343 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:06:58.348428 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.348642 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.348735 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:06:58.348959 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.349068 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:06:58.349253 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:06:58.349358 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.349576 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.349716 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.349909 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.350017 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.350261 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.350416 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.350742 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.350907 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.351694 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.351792 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352011 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352130 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352332 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352430 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352646 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352748 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.352950 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353047 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353216 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353347 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353526 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353621 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353880 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-4-iscsi {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.353983 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.354189 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.354280 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.354492 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.354585 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-4-iscsi {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.354797 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.354888 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.355115 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.355242 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.355420 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.355518 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.355734 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.355890 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.356033 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.356208 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.356517 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.356619 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.356823 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.356981 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.357127 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.357227 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.357434 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.357529 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.357762 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.357915 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.358092 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.358185 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.358533 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.358624 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.358899 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.359093 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.359207 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.359522 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.359654 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.359835 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.360157 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.360250 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.360465 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.360739 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.360844 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.361010 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.361317 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.361415 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-4-iscsi {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.361640 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.361989 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.362106 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.362319 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.362557 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.362659 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.362801 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.363119 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.363222 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.363441 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.363829 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.363930 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.364138 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.364440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.364533 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.364748 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.365006 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.365099 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.365345 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.365582 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.365675 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.365967 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.366182 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.366314 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.367116 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.367396 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.367552 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.367786 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.367977 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.368103 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.368443 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.368545 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.368690 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.368997 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.369119 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.369338 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.369658 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.369868 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.370033 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.370278 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.370379 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.370624 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.370842 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.370941 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.371225 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.371409 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.371514 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.371835 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.372106 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.372216 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.372525 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.372625 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.372770 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.373077 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.373168 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.373383 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.373622 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.373721 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.374019 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.374223 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.374317 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.374621 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.374817 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.374918 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.375214 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.375403 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.375554 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.375819 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.375997 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.376151 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.376429 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.376527 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.376760 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.376909 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.377029 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.377320 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.377499 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.377622 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.377973 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.378123 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.378297 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.378605 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.378698 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.378909 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.379214 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.379308 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.379518 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.379807 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.379908 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.380146 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.380363 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.380459 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.380738 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.380932 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.381042 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.381333 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.381489 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.381647 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.381979 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.382087 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.382841 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.383170 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.383265 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.383474 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.383770 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.383870 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.384085 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.384365 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.384451 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.384684 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.384962 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.385056 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.385276 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.385544 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.385631 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.385893 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.386169 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.386259 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.386487 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.386785 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.386917 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.387104 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.387377 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.387471 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.387717 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.387951 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.388044 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.388311 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.388580 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.388667 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.388953 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.389290 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.389395 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.389810 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.389915 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.390058 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.390294 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.390494 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.390626 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.390943 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.391090 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.391257 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.391571 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.391655 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.391895 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.392210 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.392303 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.392522 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.392778 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.392871 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.393138 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.393380 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.393467 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.393771 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.394021 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.394110 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.394413 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.394597 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.394731 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.395041 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.395134 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.395357 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.395616 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.395703 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.395995 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.396192 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.396305 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.396648 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.396789 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.396991 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.397303 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.397394 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.397628 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.397983 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.398094 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.398309 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.398552 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.398651 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.398914 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.399118 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.399235 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.399563 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.399705 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.399895 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.400188 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.400286 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.400498 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.400808 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.400900 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.401118 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.401388 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.401487 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.401725 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.402030 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.402125 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.402394 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.402608 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.402704 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.403008 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.403188 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.403325 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.403634 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.403765 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.403944 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.404252 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.404342 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.404557 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.404863 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.404960 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.405167 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.405475 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.405559 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.405777 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.406075 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.406179 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.406428 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.406647 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.406732 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.407058 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.407226 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.407364 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.407664 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.407808 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.407972 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.408281 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.408406 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.408586 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.408898 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.408984 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.409207 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.409513 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.409605 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.409858 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.410154 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.410254 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.410467 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.410731 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.410820 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.411080 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.411313 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.411406 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.411687 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.411912 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.411998 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.412303 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.412488 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.412612 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.412922 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.413060 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.413247 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.413658 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.413755 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.413997 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.414279 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.414373 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.414651 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.414853 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.414951 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.415267 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.415437 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.415592 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.415909 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.416002 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.416213 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.416524 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.416609 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.416827 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.417124 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.417211 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.417426 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.417931 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.418040 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.418040 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.418286 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.418375 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.418643 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.418864 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.418951 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.419237 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.419442 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.419558 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.419867 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.420018 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.420191 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.420467 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.420587 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.420770 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.421110 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.421204 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.421413 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.422019 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.422127 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.422447 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.422602 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.422768 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.423092 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.423191 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.423404 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.423721 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.423816 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.424115 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.424318 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:06:58.424432 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.424744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.424943 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.425057 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.425377 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.425560 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.425689 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.426037 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.426225 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.426348 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.426673 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.426809 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.426983 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.427303 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.427422 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.427608 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.427929 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.428038 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.428264 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.428595 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.428698 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.428911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.429713 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.429823 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.430079 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.430330 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.430430 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.430691 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.430935 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.431026 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.431298 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.431529 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.431621 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.431912 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.432117 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.432206 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.432525 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.432699 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.432840 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.433164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.433298 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.433475 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.433827 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.433960 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.434119 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.434434 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.434520 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.434760 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.435087 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.435180 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.435396 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.435692 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.435779 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.436014 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.436298 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.436385 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.436619 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.436881 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.436968 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.437263 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.437475 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.437572 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.437842 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.438123 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.438224 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.438454 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.438729 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.438815 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.439055 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.439309 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.439396 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.439663 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.439942 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.440035 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.440254 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.440566 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.440664 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.440884 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.441156 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.441242 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.441501 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.441758 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.441871 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.442141 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.442386 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.442472 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.442762 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.442968 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.443055 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.443359 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.443555 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.443650 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.443951 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.444132 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.444292 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.444604 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.444785 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.445446 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.445764 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.445922 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.446108 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.446417 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.446521 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.446735 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.447044 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.447130 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.447354 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.447615 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.447709 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.447977 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.448197 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.448285 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.448578 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.448774 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.448889 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.449199 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.449341 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.449509 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.449856 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.449953 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.450172 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.450537 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.450643 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.450784 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.451088 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.451174 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.451399 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.451696 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.451784 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.452269 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.452362 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.452606 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.452703 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.452923 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.453057 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.453248 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.453627 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.453745 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.454119 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.454215 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.454298 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.454542 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.454763 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.454897 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.455095 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.455207 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.455463 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.455565 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.455769 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.455901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.456076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.456219 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.456389 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.456557 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.456696 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.456923 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.457044 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.457241 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.457344 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.457586 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.457687 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.457911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458021 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458221 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458322 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458525 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458625 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458832 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.458946 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.459143 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.459244 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.459468 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.459614 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.459751 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.459884 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.460058 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.460158 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.460919 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461028 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461230 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461324 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461534 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461623 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461861 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.461951 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.462171 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.462261 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.462478 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.462564 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.462796 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.462884 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.463109 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.463199 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.463424 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.463512 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.463738 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.463839 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464062 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464173 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464363 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464460 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464688 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464786 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.464994 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.465081 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.465299 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.465385 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.465601 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.465698 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.465936 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466028 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466243 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466383 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466548 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466653 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466859 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.466947 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.467172 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.467283 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.467479 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.467585 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.467786 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.467976 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.468088 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.468289 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.468391 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.468597 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.468694 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.468990 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.469085 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.469299 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.469569 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.469659 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.469912 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.470044 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.470225 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.470361 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.470532 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.470737 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.470835 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.471054 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.471146 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.471383 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.471473 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.471696 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.471792 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472001 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472090 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472303 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472391 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472607 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472693 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.472914 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473002 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473222 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473312 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473524 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473663 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473876 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.473979 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.474192 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.474339 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.474675 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.474772 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.474862 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.475022 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.475115 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.475340 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.475428 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.475651 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.475741 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.476013 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.476643 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.476842 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.477156 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.477480 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.477760 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.477926 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.478122 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.478240 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.478430 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.478544 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.478749 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.478918 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.479165 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.479374 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.479374 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.479717 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.479906 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.480110 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.480294 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.480494 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.480680 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.480864 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.481137 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.481407 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.481537 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.481628 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.481710 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.481877 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482009 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482143 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482270 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482398 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482398 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482609 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482763 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482835 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482909 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.482978 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.483205 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.483300 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.483523 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.483622 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.483832 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.483929 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.484149 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.484247 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.484459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.484599 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.484781 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.484869 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.485090 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.485196 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.485403 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.485490 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.485704 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.485862 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486044 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486158 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486347 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486443 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486665 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486743 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.486976 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487073 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487282 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487387 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487609 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487766 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487895 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.487987 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.488202 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.488289 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.488512 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.488601 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.488817 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.488906 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.489126 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.489213 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.489434 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.489522 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.489748 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.489956 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490091 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490179 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490378 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490481 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490688 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490785 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.490996 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.491080 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.491304 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.491606 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.491753 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.491862 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.491952 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.492021 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.492241 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.492405 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.492556 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.492731 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.492853 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.493045 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.493163 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.493366 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.493455 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.493689 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.493777 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494023 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494125 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494326 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494427 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494647 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494786 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.494957 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.495054 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.495259 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.495379 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.495564 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.495664 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.495868 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.496038 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.496214 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.496432 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.496529 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.496810 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.496896 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.497126 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.497259 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.497446 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.497569 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.497755 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.497998 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.498092 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.498314 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.498393 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.498684 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.498821 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.499081 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.499281 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.499406 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.499689 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.499803 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.500025 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.500127 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.500420 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.500533 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.500736 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.500852 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.501050 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.501152 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.501365 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.501456 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.501697 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.501917 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.502010 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.502102 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.502329 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.502427 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.502706 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.502804 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503015 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503112 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503323 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503630 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503719 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.503955 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.504222 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.504311 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.504558 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.504654 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.504874 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.505019 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.505191 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.505281 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.505511 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.505613 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.505927 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.506049 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.506177 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.506303 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.506611 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.506718 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.506929 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.507017 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.507769 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.507874 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508078 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508167 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508382 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508469 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508686 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508782 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.508995 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.509089 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.509353 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.509465 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.509601 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.509695 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.509926 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510020 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510235 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510460 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510551 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510621 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510832 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.510923 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.511133 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.511232 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.511435 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.511529 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.511749 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.511852 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.512063 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.512286 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.512494 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.512583 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.512799 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.512886 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.513119 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.513209 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.513426 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.513522 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.513728 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.513871 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514054 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514153 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514357 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514446 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514659 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514745 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.514968 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.515109 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.515291 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.515379 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.515596 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.515683 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.515906 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516003 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516217 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516304 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516520 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516615 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516823 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.516918 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.517128 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.517215 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.517427 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.517519 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.517728 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.517956 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.518063 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.518203 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.518369 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.518520 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.518729 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.518842 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.519041 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.519163 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.519351 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.519453 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.519660 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.519776 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520045 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520133 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520359 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520449 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520666 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520753 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.520966 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.521052 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.521281 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.521371 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.521586 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.521673 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.522102 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.522250 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.522354 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.522446 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.522634 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.523465 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.523568 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.523784 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.523883 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.524088 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.524178 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.524398 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.524487 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.524833 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.525030 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.525237 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.525657 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.525765 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526033 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526225 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526225 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526369 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526444 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526519 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526638 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526740 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.526939 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527026 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527257 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527345 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527567 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527669 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527866 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.527954 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.528165 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.528254 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.528466 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.528555 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.528766 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.528853 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.529066 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.529161 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.529369 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.529459 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.529687 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.529827 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530018 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530105 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530316 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530404 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530618 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530705 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.530919 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531006 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531220 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531309 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531518 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531608 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531821 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.531919 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.532127 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.532251 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.532416 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.532507 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.532712 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.532813 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533010 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533099 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533309 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533405 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533626 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533727 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.533953 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534071 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534252 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534342 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534552 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534644 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534851 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.534949 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.535192 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.535280 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.535491 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.535580 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.535842 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.535939 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.536146 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.536234 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.536460 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.536546 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.536772 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.537024 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.537335 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.537442 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.537532 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.537846 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.537967 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.538066 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.538500 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.538618 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.538711 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.538929 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.539034 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.539121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.539356 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.539452 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.539543 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.539625 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540034 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540149 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540234 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540322 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540405 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540496 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540741 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.540836 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541007 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541106 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541431 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541549 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541635 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541873 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.541981 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542067 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542264 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542490 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542734 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542819 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542900 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.542989 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.543136 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.543293 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.543670 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.543848 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.543937 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.544329 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.544443 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.544529 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.544618 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.544700 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.544924 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545012 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545102 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545197 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545279 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545591 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545686 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545827 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.545927 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.546010 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.546091 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.546317 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.546509 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.546621 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.546715 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.547276 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.547372 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.547506 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.547998 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.547998 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.548175 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.548326 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.548416 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.548505 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.548597 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549072 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549168 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549252 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549482 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549482 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549880 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.549974 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.550056 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.550306 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.550395 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.550684 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551050 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551154 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551252 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551336 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551417 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551498 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551693 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551792 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551876 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.551956 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552037 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552157 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552313 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552462 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552591 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552763 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.552899 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.553062 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.553204 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.553368 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.553531 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.553686 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.553930 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.554159 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.554258 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.554489 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.554600 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.554762 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.554862 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.555080 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.555329 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.555772 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.555880 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.555972 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556065 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556215 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556345 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556522 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556646 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556822 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.556936 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.557217 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.557314 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.557524 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.557613 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.557852 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558032 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558162 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558249 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558481 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558589 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558782 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.558880 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559081 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559178 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559384 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559515 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559686 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559781 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.559991 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560078 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560294 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560388 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560603 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560692 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560906 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.560994 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.561211 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.561298 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.561520 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.561607 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.561846 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.561938 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.562154 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.562252 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.562465 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.562544 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.562766 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.562871 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563069 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563251 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563374 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563544 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563681 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563802 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.563977 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.564122 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.564281 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565181 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565389 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565486 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565558 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565708 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565817 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565895 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.565963 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566030 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566096 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566177 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566248 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566322 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566448 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566524 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566737 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.566837 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567045 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567130 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567367 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567457 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567675 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567771 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.567991 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.568079 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.568834 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.568940 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.568940 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.569096 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.569096 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.569231 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.569305 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.569392 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.569509 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.570311 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.570411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.570649 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.570747 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.570963 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.571052 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.571263 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.571352 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.571564 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.571652 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.571909 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572005 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572219 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572327 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572524 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572612 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572851 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.572939 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.573163 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.573387 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.573497 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.573724 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.573864 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574071 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574156 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574377 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574472 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574688 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574777 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.574996 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.575092 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.575306 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.575394 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.575616 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.575704 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.575916 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576000 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576223 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576328 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576535 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576636 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.576937 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.577141 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.577253 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.577438 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.577532 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.577746 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.577890 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578069 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578168 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578373 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578472 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578672 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578819 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.578990 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.579092 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.579292 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.579383 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.579613 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.579745 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.579917 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580054 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580223 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580326 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580523 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580652 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580820 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.580912 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.581141 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.581271 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.581447 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.581529 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.581774 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.581899 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.582191 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.582279 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.582504 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.582581 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.582825 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.582903 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.583218 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.583346 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.583539 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.583674 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.583858 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584003 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584167 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584302 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584479 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584610 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584788 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.584918 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.585098 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.585219 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.585501 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.586302 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.586459 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.586603 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.586748 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.586883 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.587098 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.587247 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.587382 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.587513 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.587649 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.587751 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.588156 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.589879 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.591774 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.591924 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592228 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592383 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592579 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592729 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592856 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.592978 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593104 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593241 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593369 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593500 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593643 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593643 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.593950 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594101 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594244 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594370 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594493 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594616 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594746 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.594875 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595005 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595144 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595271 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595422 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595571 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595713 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.595996 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.596145 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.596348 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.596492 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.596621 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.596746 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.596886 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597022 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597291 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597426 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597555 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597680 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.597839 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598097 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598239 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598377 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598513 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598648 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598793 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.598921 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.599036 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.599255 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.599414 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.599579 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.599753 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.599892 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600018 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600154 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600279 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600544 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600668 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.600804 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.601442 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.601566 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.601667 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.601849 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.601993 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602137 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602304 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602467 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602618 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602737 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602859 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.602974 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603074 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603170 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603279 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603279 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603482 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603583 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603682 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603781 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.603908 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604029 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604144 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604246 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604246 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604452 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604563 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604681 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604681 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604865 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.604973 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605092 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605208 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605322 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605434 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605546 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605672 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605818 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.605951 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606067 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606184 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606301 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606484 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606613 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606729 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606842 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.606964 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607124 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607253 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607368 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607480 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607601 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607601 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607813 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.607945 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608085 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608207 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608333 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608460 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608577 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608704 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608830 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.608947 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609063 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609186 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609312 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609428 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609541 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609655 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609769 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.609909 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.610040 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.610157 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.610270 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.610383 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:06:58.610496 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.610658 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.610961 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.611271 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.611581 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.611880 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.612187 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.612487 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.612806 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.613106 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.613406 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.613740 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.614111 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.614414 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.614717 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.615021 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.615321 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.615629 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.615928 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.616236 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.616559 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.617431 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.617697 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.618027 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.618931 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.618931 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.619228 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.619343 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.619592 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.619900 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.620222 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.620533 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.620842 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.621257 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.621572 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.622268 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.622595 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.622916 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.623256 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.623585 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.623892 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.624198 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.624502 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.624825 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.625136 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.625443 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.625751 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.626083 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.626392 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.626699 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.627005 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.627310 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.627620 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.627926 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.628233 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.628540 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.628844 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.629151 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.629459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.629856 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.630143 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.630461 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.630774 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.631095 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.631403 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.631713 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.632024 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.632486 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.632804 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.633135 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.633451 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.633755 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.634204 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.634520 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.634837 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.635155 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.635463 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.635780 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.636101 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.636409 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.636727 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.637035 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.637359 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.637702 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.638051 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.638370 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.638696 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.638957 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.639258 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.639563 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.639877 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.640182 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.640482 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.640785 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.641091 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.641390 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.641689 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.642019 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.642319 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.642621 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.642918 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.643218 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.643523 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.643821 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.644121 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.644422 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.644724 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.645021 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.645323 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.645621 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.651395 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.652966 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.652966 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.652966 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.653210 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.653329 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.653655 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.654013 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.654336 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.654673 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.655003 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.655331 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.655653 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.655993 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.656308 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.656622 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.656936 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.658530 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.658530 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.658530 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.658530 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.658530 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.658909 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.659119 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.659440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.659766 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.660083 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.660397 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.660728 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.661042 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.661354 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.661665 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.662004 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.662319 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.662638 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.662951 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.663263 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.664210 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.664531 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.664866 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.665196 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.665511 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.665861 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.666192 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.666548 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.666862 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.667210 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.667540 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.667857 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.668173 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.668866 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:06:58.668866 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:06:58.765089 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO dbcounter [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Registered counter for database nova_api Aug 02 10:06:58.787381 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_db.sqlalchemy.engines [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:58.795452 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writer thread running {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:58.828736 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Registered counter for database nova_api Aug 02 10:06:58.849388 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:58.856717 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:58.858497 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.context [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df30d8db-5664-49ef-9995-24fa3fa4271f(cell1) {{(pid=103435) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:06:58.862525 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:06:58.864084 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:06:58.864855 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:06:58.867434 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:06:58.869403 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO dbcounter [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Registered counter for database nova_cell0 Aug 02 10:06:58.876438 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO dbcounter [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Registered counter for database nova_cell1 Aug 02 10:06:58.884796 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_db.sqlalchemy.engines [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:58.886255 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_db.sqlalchemy.engines [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:58.892562 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writer thread running {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:58.895547 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writer thread running {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:58.913371 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.context [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df30d8db-5664-49ef-9995-24fa3fa4271f(cell1) {{(pid=103434) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:06:58.918017 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:06:58.919603 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:06:58.920399 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:06:58.922676 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:06:58.924658 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Registered counter for database nova_cell0 Aug 02 10:06:58.930278 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Registered counter for database nova_cell1 Aug 02 10:06:58.938712 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:58.941505 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:58.945688 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:58.951377 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:59.052908 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO dbcounter [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Registered counter for database nova_cell0 Aug 02 10:06:59.064805 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_db.sqlalchemy.engines [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:59.070747 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writer thread running {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:59.096510 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Registered counter for database nova_cell0 Aug 02 10:06:59.110286 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:06:59.114848 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:06:59.411677 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: WARNING keystonemiddleware.auth_token [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:06:59.419847 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: WARNING keystonemiddleware.auth_token [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:06:59.447989 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:06:59.455212 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:06:59.770615 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: WARNING keystonemiddleware.auth_token [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:06:59.777409 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: WARNING keystonemiddleware.auth_token [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:06:59.782898 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56140286c9c0 pid: 103435 (default app) Aug 02 10:06:59.785070 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:06:59.786305 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] 10.222.0.82 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001853 Aug 02 10:06:59.786717 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 788 bytes} [Tue Aug 2 10:06:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:06:59.819026 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:06:59.826405 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-37e202da-ec7e-4c9a-8e50-7c6395dc9ec2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:06:59.834670 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56140286c9c0 pid: 103434 (default app) Aug 02 10:08:19.447287 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:19.448306 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 02 10:08:19.448730 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 2/2] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:19.465372 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:19.466363 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_cell0:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:19.467372 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_cell1:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:19.468250 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_cell0:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:20.412091 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-56f85ef0-f59b-4d82-9617-bdca40e423d3 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:20.448349 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-56f85ef0-f59b-4d82-9617-bdca40e423d3 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.992576 Aug 02 10:08:20.449265 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 1/3] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Aug 2 10:08:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:08:22.757711 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:22.758782 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-e5393ba9-3f6c-451d-8d01-3a2e08bbbf45 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Aug 02 10:08:22.760667 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 3/4] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:23.265222 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-078e0508-fd89-4729-bced-848dd0246a78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:23.286488 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:08:23.286488 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: warnings.warn(msg) Aug 02 10:08:23.321910 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-078e0508-fd89-4729-bced-848dd0246a78 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.556198 Aug 02 10:08:23.322819 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 2/5] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:08:23.604429 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-1335adf0-79b8-47c6-8e29-9e22ddc8750b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:23.608828 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:08:23.608828 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: warnings.warn(msg) Aug 02 10:08:23.629731 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_api:SELECT=3 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:23.630702 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_cell0:SELECT=3 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:23.631645 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_cell1:SELECT=3 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:23.632789 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:23.677467 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-1335adf0-79b8-47c6-8e29-9e22ddc8750b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.345771 Aug 02 10:08:23.681991 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 4/6] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Aug 2 10:08:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:08:25.958600 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-078e0508-fd89-4729-bced-848dd0246a78 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:25.960487 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-078e0508-fd89-4729-bced-848dd0246a78 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Aug 02 10:08:25.965941 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 3/7] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:26.759977 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-8e676524-338b-447e-bb85-92b880225b40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:26.780112 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:08:26.780112 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: warnings.warn(msg) Aug 02 10:08:26.810553 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-8e676524-338b-447e-bb85-92b880225b40 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.842478 Aug 02 10:08:26.812447 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 5/8] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:08:26.826985 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1abce49c-cb41-4f40-909b-6f5c8d476f32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:26.830372 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:08:26.830372 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: warnings.warn(msg) Aug 02 10:08:26.873452 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1abce49c-cb41-4f40-909b-6f5c8d476f32 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052458 Aug 02 10:08:26.874789 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 4/9] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Aug 2 10:08:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:08:29.124946 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-8e676524-338b-447e-bb85-92b880225b40 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:29.127060 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-8e676524-338b-447e-bb85-92b880225b40 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004465 Aug 02 10:08:29.128098 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 6/10] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:29.549248 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-0c20a292-b355-4625-9ceb-0ecffb751acf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "vcpus": 1}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:29.568847 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-0c20a292-b355-4625-9ceb-0ecffb751acf admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435041 Aug 02 10:08:29.569431 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 5/11] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:08:29.581831 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-ce307d5b-81a1-4ef7-afa3-497213877490 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:29.606120 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-ce307d5b-81a1-4ef7-afa3-497213877490 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028561 Aug 02 10:08:29.606693 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 7/12] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Aug 2 10:08:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:08:31.880964 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-0c20a292-b355-4625-9ceb-0ecffb751acf admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:31.885960 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-0c20a292-b355-4625-9ceb-0ecffb751acf admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 02 10:08:31.886397 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 6/13] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:32.332451 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-d7c94fb8-1fef-40d4-9f70-10b0c511c4cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "swap": 0, "ram": 2048}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:32.366805 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-d7c94fb8-1fef-40d4-9f70-10b0c511c4cb admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473894 Aug 02 10:08:32.367966 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 8/14] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:08:32.380212 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-7817e9c1-a41a-404f-ac35-983bba9496e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:32.411961 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-7817e9c1-a41a-404f-ac35-983bba9496e5 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035342 Aug 02 10:08:32.413144 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 7/15] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Aug 2 10:08:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:08:34.778854 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-d7c94fb8-1fef-40d4-9f70-10b0c511c4cb admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:34.779875 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-d7c94fb8-1fef-40d4-9f70-10b0c511c4cb admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 02 10:08:34.780280 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 9/16] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:35.286585 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-495943c2-5f91-4806-a3a0-8cca61eba12b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:35.309345 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-495943c2-5f91-4806-a3a0-8cca61eba12b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521603 Aug 02 10:08:35.310438 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 8/17] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:08:35.323901 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-d8e90513-847f-4581-8014-c2ae1e20b736 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:35.351887 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-d8e90513-847f-4581-8014-c2ae1e20b736 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032093 Aug 02 10:08:35.352654 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 10/18] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Aug 2 10:08:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:08:37.617199 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-495943c2-5f91-4806-a3a0-8cca61eba12b admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:37.618378 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-495943c2-5f91-4806-a3a0-8cca61eba12b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Aug 02 10:08:37.618847 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 9/19] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:38.064839 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-82ccd31f-b03a-4829-a52d-e6acc9401b1e admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:38.090915 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-82ccd31f-b03a-4829-a52d-e6acc9401b1e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465658 Aug 02 10:08:38.091501 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 11/20] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Aug 2 10:08:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:08:40.507204 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-495943c2-5f91-4806-a3a0-8cca61eba12b admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:40.508353 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-495943c2-5f91-4806-a3a0-8cca61eba12b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 02 10:08:40.508813 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 10/21] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:41.049171 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9e7db435-2c77-4187-a646-8bf80d267328 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "swap": 0, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:41.072088 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9e7db435-2c77-4187-a646-8bf80d267328 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.556591 Aug 02 10:08:41.073171 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 12/22] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:08:41.085242 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-5b33b704-f353-41c9-ab54-320dd5e0a9ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:41.115693 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-5b33b704-f353-41c9-ab54-320dd5e0a9ea admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032619 Aug 02 10:08:41.115693 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 11/23] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Aug 2 10:08:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:08:43.518204 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9e7db435-2c77-4187-a646-8bf80d267328 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:43.519225 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9e7db435-2c77-4187-a646-8bf80d267328 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 02 10:08:43.519646 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 13/24] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:43.938301 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-247a03c6-76b1-4880-ae6e-538f5c9fe60d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:43.958225 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-247a03c6-76b1-4880-ae6e-538f5c9fe60d admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.432715 Aug 02 10:08:43.958769 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 12/25] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:08:43.971063 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-2fe008f1-b9d8-4632-9540-020177197b2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:43.994826 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-2fe008f1-b9d8-4632-9540-020177197b2e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027905 Aug 02 10:08:43.995555 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 14/26] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Aug 2 10:08:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:08:46.281021 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-247a03c6-76b1-4880-ae6e-538f5c9fe60d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:46.283337 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-247a03c6-76b1-4880-ae6e-538f5c9fe60d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002735 Aug 02 10:08:46.283760 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 13/27] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:46.722832 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-22c62c5d-1f66-4941-9067-3cd53644c875 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:46.745418 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-22c62c5d-1f66-4941-9067-3cd53644c875 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455241 Aug 02 10:08:46.746012 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 15/28] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:08:46.759835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-4d730831-d9b7-480c-b45d-1d26ec87230d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:46.787076 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-4d730831-d9b7-480c-b45d-1d26ec87230d admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030943 Aug 02 10:08:46.787653 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 14/29] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Aug 2 10:08:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:08:49.324119 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-22c62c5d-1f66-4941-9067-3cd53644c875 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:49.325828 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-22c62c5d-1f66-4941-9067-3cd53644c875 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003219 Aug 02 10:08:49.326516 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 16/30] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:49 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:08:49.890479 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-233d286d-c6de-4de4-985f-8aa4d352539b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "disk": 80}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:49.898773 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:08:49.914530 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-233d286d-c6de-4de4-985f-8aa4d352539b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.576786 Aug 02 10:08:49.915844 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 15/31] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:08:49.928413 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-be6d9e16-46e5-4c64-bcac-327ded43c2cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:49.972070 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-be6d9e16-46e5-4c64-bcac-327ded43c2cc admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047505 Aug 02 10:08:49.987694 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 17/32] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Aug 2 10:08:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:08:52.551550 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-233d286d-c6de-4de4-985f-8aa4d352539b admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:08:52.552571 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-233d286d-c6de-4de4-985f-8aa4d352539b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 02 10:08:52.552976 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 16/33] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:08:53.033663 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9d0e0a11-41ec-4356-9a38-63865155c90e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "swap": 0, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge"}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:53.056008 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9d0e0a11-41ec-4356-9a38-63865155c90e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.495152 Aug 02 10:08:53.056990 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 18/34] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Aug 2 10:08:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:08:53.070029 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-2496262e-f4a1-4955-ab96-8b28e5d41eb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:08:53.102177 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-2496262e-f4a1-4955-ab96-8b28e5d41eb4 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035942 Aug 02 10:08:53.102779 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 17/35] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Aug 2 10:08:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:09:13.572258 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9d0e0a11-41ec-4356-9a38-63865155c90e admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:13.573672 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9d0e0a11-41ec-4356-9a38-63865155c90e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001874 Aug 02 10:09:13.574221 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 19/36] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:09:13.585809 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:14.013976 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-3ae0e463-8d2d-4f0e-9a01-86d9033b765e admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:14.033997 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-3ae0e463-8d2d-4f0e-9a01-86d9033b765e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.452496 Aug 02 10:09:14.034544 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 18/37] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Aug 2 10:09:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:09:15.162948 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9d0e0a11-41ec-4356-9a38-63865155c90e admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:15.163976 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9d0e0a11-41ec-4356-9a38-63865155c90e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 02 10:09:15.164407 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 20/38] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:09:15.739025 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-de905b27-89f6-4880-af00-5b7a94d81782 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:15.747167 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.wsgi [None req-de905b27-89f6-4880-af00-5b7a94d81782 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-de905b27-89f6-4880-af00-5b7a94d81782 admin admin] Request method failure captured: Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Accept: application/json Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Accept-Encoding: gzip, deflate Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Connection: keep-alive Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Content-Length: 0 Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Host: 10.222.0.82 Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Openstack-Api-Version: compute 2.90 Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Openstack-System-Scope: None Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: User-Agent: python-novaclient Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Auth-Token: gAAAAABi6PfLITw8A7mA8ysZarofNVMs7w0jTlS8N0cqK2K7lYDCqWnfd8VqAYe1IDJKUDNgFPEiAmyx_whoonYc7HPjtCU9tKFpTQucJuQkmrbZXcyv7cQu-bOjFBXP6LAs5A5Us4KpO8CKewuwcn8akWhLZs_9ldV-CK0xQFGjsm3LHxh6xPA Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Domain-Id: None Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Domain-Name: None Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Identity-Status: Confirmed Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Is-Admin-Project: True Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Domain-Id: default Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Domain-Name: Default Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Name: admin Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Role: admin,reader,member Aug 02 10:09:15.751300 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Roles: admin,reader,member Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_7047912c5acd4adeba5d87c3bf895e39", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant: admin Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant-Name: admin Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User: admin Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Domain-Id: default Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Domain-Name: Default Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Id: 891005fa5ff74041b75747d16cc66798 Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Name: admin Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: method: > Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: exception: Flavor 42 could not be found. Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: action_args: {'id': '42'} Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:09:15.753440 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:15.755067 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.757459 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-de905b27-89f6-4880-af00-5b7a94d81782 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:09:15.759658 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-de905b27-89f6-4880-af00-5b7a94d81782 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.446396 Aug 02 10:09:15.759658 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 19/39] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Aug 2 10:09:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:15.766375 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-0a638180-3101-44f2-b0cd-d3b6e2a994c3 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:15.773231 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:15.793960 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-0a638180-3101-44f2-b0cd-d3b6e2a994c3 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034304 Aug 02 10:09:15.794533 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 21/40] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Aug 2 10:09:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:09:15.809514 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-0460ac69-2830-41cf-84b4-fb472e541668 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:15.839241 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-0460ac69-2830-41cf-84b4-fb472e541668 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034764 Aug 02 10:09:15.839827 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 20/41] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Aug 2 10:09:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:09:15.852007 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-042bc6ae-0b25-4e20-b490-09a594393786 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:15.860509 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.wsgi [None req-042bc6ae-0b25-4e20-b490-09a594393786 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-042bc6ae-0b25-4e20-b490-09a594393786 admin admin] Request method failure captured: Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Accept: application/json Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Accept-Encoding: gzip, deflate Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Connection: keep-alive Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Content-Length: 0 Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Host: 10.222.0.82 Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Openstack-Api-Version: compute 2.90 Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Openstack-System-Scope: None Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: User-Agent: python-novaclient Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Auth-Token: gAAAAABi6PfLITw8A7mA8ysZarofNVMs7w0jTlS8N0cqK2K7lYDCqWnfd8VqAYe1IDJKUDNgFPEiAmyx_whoonYc7HPjtCU9tKFpTQucJuQkmrbZXcyv7cQu-bOjFBXP6LAs5A5Us4KpO8CKewuwcn8akWhLZs_9ldV-CK0xQFGjsm3LHxh6xPA Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Domain-Id: None Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Domain-Name: None Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Identity-Status: Confirmed Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Is-Admin-Project: True Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Domain-Id: default Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Domain-Name: Default Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Name: admin Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Role: admin,reader,member Aug 02 10:09:15.864164 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Roles: admin,reader,member Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_7047912c5acd4adeba5d87c3bf895e39", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant: admin Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant-Name: admin Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User: admin Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Domain-Id: default Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Domain-Name: Default Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Id: 891005fa5ff74041b75747d16cc66798 Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Name: admin Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: method: > Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: exception: Flavor 42 could not be found. Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: action_args: {'id': '42'} Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:09:15.866744 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:15.867780 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:15.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-042bc6ae-0b25-4e20-b490-09a594393786 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:09:15.870894 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-042bc6ae-0b25-4e20-b490-09a594393786 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.019110 Aug 02 10:09:15.870894 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 22/42] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Aug 2 10:09:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:16.876724 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-0460ac69-2830-41cf-84b4-fb472e541668 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:16.877733 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-0460ac69-2830-41cf-84b4-fb472e541668 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 02 10:09:16.878161 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 21/43] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:09:17.443887 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-85584945-7735-4450-b63a-69d2ea3b8f6b admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:17.449372 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.wsgi [None req-85584945-7735-4450-b63a-69d2ea3b8f6b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-85584945-7735-4450-b63a-69d2ea3b8f6b admin admin] Request method failure captured: Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Accept: application/json Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Accept-Encoding: gzip, deflate Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Connection: keep-alive Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Content-Length: 0 Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Host: 10.222.0.82 Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Openstack-Api-Version: compute 2.90 Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Openstack-System-Scope: None Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: User-Agent: python-novaclient Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Auth-Token: gAAAAABi6PfMFU5dSIA2c-uHy4s5Dei27azjy6T3gMyEQgMdGa3xGg53iIOoVhFW0EJZPcmS-Abn7V9DlZhKGAB3d0uBkEA55ZZaniup6xxh8aD_oDlWKhM88MSSoBSUgEHgLFt64nc6flx-6D0l2tLlp3HoxyteFDniqX4KBDvmPosLO78smyo Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Domain-Id: None Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Domain-Name: None Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Identity-Status: Confirmed Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Is-Admin-Project: True Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Domain-Id: default Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Domain-Name: Default Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Name: admin Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Role: admin,reader,member Aug 02 10:09:17.450911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Roles: admin,reader,member Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_7047912c5acd4adeba5d87c3bf895e39", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant: admin Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant-Name: admin Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User: admin Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Domain-Id: default Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Domain-Name: Default Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Id: 891005fa5ff74041b75747d16cc66798 Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Name: admin Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: method: > Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: exception: Flavor 84 could not be found. Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: action_args: {'id': '84'} Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:09:17.452488 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:17.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.456491 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-85584945-7735-4450-b63a-69d2ea3b8f6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:09:17.457884 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-85584945-7735-4450-b63a-69d2ea3b8f6b admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.433557 Aug 02 10:09:17.457884 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 23/44] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Aug 2 10:09:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:17.462778 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-ecc6ceeb-b7ad-444d-bb77-4c2160c4de95 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:17.477635 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-ecc6ceeb-b7ad-444d-bb77-4c2160c4de95 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018525 Aug 02 10:09:17.478208 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 22/45] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Aug 2 10:09:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:09:17.488165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9e018243-1313-42ea-8fa0-7f68b7ae9b4f admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:17.505594 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9e018243-1313-42ea-8fa0-7f68b7ae9b4f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021153 Aug 02 10:09:17.506189 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 24/46] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Aug 2 10:09:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:09:17.516691 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-4ae4cf6f-4b01-4a4a-bc39-8ebd75ae93ef admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:17.522326 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.wsgi [None req-4ae4cf6f-4b01-4a4a-bc39-8ebd75ae93ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-4ae4cf6f-4b01-4a4a-bc39-8ebd75ae93ef admin admin] Request method failure captured: Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Accept: application/json Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Accept-Encoding: gzip, deflate Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Connection: keep-alive Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Content-Length: 0 Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Host: 10.222.0.82 Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Openstack-Api-Version: compute 2.90 Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Openstack-System-Scope: None Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: User-Agent: python-novaclient Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Auth-Token: gAAAAABi6PfMFU5dSIA2c-uHy4s5Dei27azjy6T3gMyEQgMdGa3xGg53iIOoVhFW0EJZPcmS-Abn7V9DlZhKGAB3d0uBkEA55ZZaniup6xxh8aD_oDlWKhM88MSSoBSUgEHgLFt64nc6flx-6D0l2tLlp3HoxyteFDniqX4KBDvmPosLO78smyo Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Domain-Id: None Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Domain-Name: None Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Identity-Status: Confirmed Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Is-Admin-Project: True Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Domain-Id: default Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Domain-Name: Default Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Name: admin Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Role: admin,reader,member Aug 02 10:09:17.523835 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Roles: admin,reader,member Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_7047912c5acd4adeba5d87c3bf895e39", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant: admin Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant-Name: admin Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User: admin Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Domain-Id: default Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Domain-Name: Default Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Id: 891005fa5ff74041b75747d16cc66798 Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Name: admin Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: method: > Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: exception: Flavor 84 could not be found. Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: action_args: {'id': '84'} Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:09:17.527690 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:17.528506 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:17.529840 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-4ae4cf6f-4b01-4a4a-bc39-8ebd75ae93ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:09:17.530994 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-4ae4cf6f-4b01-4a4a-bc39-8ebd75ae93ef admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012834 Aug 02 10:09:17.530994 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 23/47] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Aug 2 10:09:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 10:09:18.551960 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9e018243-1313-42ea-8fa0-7f68b7ae9b4f admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:18.553027 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9e018243-1313-42ea-8fa0-7f68b7ae9b4f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 02 10:09:18.553422 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 25/48] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:09:19.135281 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-88facc2b-aec3-4de0-9e34-c1e0347882aa admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:19.141283 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.wsgi [None req-88facc2b-aec3-4de0-9e34-c1e0347882aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-88facc2b-aec3-4de0-9e34-c1e0347882aa admin admin] Request method failure captured: Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Accept: application/json Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Accept-Encoding: gzip, deflate Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Connection: keep-alive Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Content-Length: 0 Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Host: 10.222.0.82 Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Openstack-Api-Version: compute 2.90 Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Openstack-System-Scope: None Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: User-Agent: python-novaclient Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Auth-Token: gAAAAABi6PfO74_CMTqv0iMC2hDUGkGQRArehgintKOa3WYNDH-dM37H0EhE7hOcG9DqjoFOyFPSsC762WIEBZkQXJBUlaIk7aVD6CVDmyBBJPn1iNqc8dJKdhj30_nXyppFZeh5yNxnIRXhKluEbwqWhss2r3k2cvpqGJDkyon9_Woe5g3kPBQ Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Domain-Id: None Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Domain-Name: None Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Identity-Status: Confirmed Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Is-Admin-Project: True Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Domain-Id: default Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Domain-Name: Default Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Project-Name: admin Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Role: admin,reader,member Aug 02 10:09:19.142901 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Roles: admin,reader,member Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_7047912c5acd4adeba5d87c3bf895e39", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant: admin Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-Tenant-Name: admin Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User: admin Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Domain-Id: default Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Domain-Name: Default Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Id: 891005fa5ff74041b75747d16cc66798 Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: X-User-Name: admin Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: method: > Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: exception: Flavor 451 could not be found. Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: action_args: {'id': '451'} Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:09:19.145411 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:19.147334 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.149850 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-88facc2b-aec3-4de0-9e34-c1e0347882aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:09:19.152189 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-88facc2b-aec3-4de0-9e34-c1e0347882aa admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.449180 Aug 02 10:09:19.152189 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 24/49] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Aug 2 10:09:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:19.158808 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-424da638-a044-43e0-ae8e-28cf731d1fc4 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:19.175225 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-424da638-a044-43e0-ae8e-28cf731d1fc4 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021485 Aug 02 10:09:19.175788 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 26/50] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Aug 2 10:09:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:09:19.185669 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:19.200674 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018587 Aug 02 10:09:19.201228 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 25/51] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Aug 2 10:09:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:09:19.211925 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-dc5820a7-2b92-4a8f-a86e-4ea1c5237495 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:19.218649 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.wsgi [None req-dc5820a7-2b92-4a8f-a86e-4ea1c5237495 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-dc5820a7-2b92-4a8f-a86e-4ea1c5237495 admin admin] Request method failure captured: Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Accept: application/json Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Accept-Encoding: gzip, deflate Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Connection: keep-alive Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Content-Length: 0 Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Host: 10.222.0.82 Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Openstack-Api-Version: compute 2.90 Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Openstack-System-Scope: None Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: User-Agent: python-novaclient Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Auth-Token: gAAAAABi6PfO74_CMTqv0iMC2hDUGkGQRArehgintKOa3WYNDH-dM37H0EhE7hOcG9DqjoFOyFPSsC762WIEBZkQXJBUlaIk7aVD6CVDmyBBJPn1iNqc8dJKdhj30_nXyppFZeh5yNxnIRXhKluEbwqWhss2r3k2cvpqGJDkyon9_Woe5g3kPBQ Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Domain-Id: None Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Domain-Name: None Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Identity-Status: Confirmed Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Is-Admin-Project: True Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Domain-Id: default Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Domain-Name: Default Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Project-Name: admin Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Role: admin,reader,member Aug 02 10:09:19.220165 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Roles: admin,reader,member Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/7047912c5acd4adeba5d87c3bf895e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_7047912c5acd4adeba5d87c3bf895e39", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant: admin Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant-Id: 7047912c5acd4adeba5d87c3bf895e39 Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-Tenant-Name: admin Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User: admin Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Domain-Id: default Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Domain-Name: Default Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Id: 891005fa5ff74041b75747d16cc66798 Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: X-User-Name: admin Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: method: > Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: exception: Flavor 451 could not be found. Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: action_args: {'id': '451'} Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:09:19.222419 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:19.223511 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: ERROR nova.api.openstack.wsgi Aug 02 10:09:19.225410 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-dc5820a7-2b92-4a8f-a86e-4ea1c5237495 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:09:19.227386 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-dc5820a7-2b92-4a8f-a86e-4ea1c5237495 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013289 Aug 02 10:09:19.227386 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 27/52] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Aug 2 10:09:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 10:09:20.228432 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:20.229803 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001800 Aug 02 10:09:20.230290 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 26/53] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:09:20.798177 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-c79b0596-78f4-4218-821f-e4946b463e4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:09:20.826911 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-c79b0596-78f4-4218-821f-e4946b463e4a admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.456700 Aug 02 10:09:20.828356 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 28/54] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Aug 2 10:09:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:09:21.846950 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:21.848477 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001805 Aug 02 10:09:21.849239 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 27/55] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:09:22.428481 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-3d3f89a3-a0ea-4eaa-976e-e466b08a03cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:09:22.446833 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-3d3f89a3-a0ea-4eaa-976e-e466b08a03cb admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.448467 Aug 02 10:09:22.447457 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 29/56] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Aug 2 10:09:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:09:23.452669 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:23.453672 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 02 10:09:23.454115 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 28/57] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:09:24.024940 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-04b9b82a-960e-452d-b4a8-dff0812f4f19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:09:24.046332 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-04b9b82a-960e-452d-b4a8-dff0812f4f19 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.449582 Aug 02 10:09:24.046899 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 30/58] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Aug 2 10:09:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:09:25.047519 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:25.048557 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 02 10:09:25.048955 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 29/59] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:09:25.596280 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-bd649037-c509-47c5-8f47-7a38e21280a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:09:25.615906 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-bd649037-c509-47c5-8f47-7a38e21280a1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.424405 Aug 02 10:09:25.616486 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 31/60] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Aug 2 10:09:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:09:26.663576 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:26.664639 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 02 10:09:26.665036 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 30/61] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:09:27.219425 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-86337661-8eb2-4a75-b620-ed34cb2e426c admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:09:27.239556 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-86337661-8eb2-4a75-b620-ed34cb2e426c admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.433950 Aug 02 10:09:27.240122 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 32/62] 10.222.0.82 () {60 vars in 1202 bytes} [Tue Aug 2 10:09:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:10:20.167463 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:10:20.169329 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f1617b1b-97a4-4e9a-81f7-921fbe189b0d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001794 Aug 02 10:10:20.169734 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 31/63] 10.222.0.82 () {54 vars in 930 bytes} [Tue Aug 2 10:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:10:20.180406 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:10:20.597522 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-ec60b895-af19-4627-9152-a4101e8c1424 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:10:20.618265 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-ec60b895-af19-4627-9152-a4101e8c1424 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.442328 Aug 02 10:10:20.618823 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 33/64] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Aug 2 10:10:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:10:20.639717 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=14 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:10:20.643833 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-94a50b38-87fa-4336-ba5f-8d550c0a4727 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:10:20.651512 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-94a50b38-87fa-4336-ba5f-8d550c0a4727 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013402 Aug 02 10:10:20.652042 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 32/65] 10.222.0.82 () {60 vars in 1282 bytes} [Tue Aug 2 10:10:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:10:20.664544 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-acf6d0ae-c571-4e77-9b6d-475dfd594fac admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:10:20.673056 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-acf6d0ae-c571-4e77-9b6d-475dfd594fac admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012145 Aug 02 10:10:20.673586 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 34/66] 10.222.0.82 () {60 vars in 1285 bytes} [Tue Aug 2 10:10:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:10:20.685830 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:10:20.693514 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011246 Aug 02 10:10:20.694016 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 33/67] 10.222.0.82 () {60 vars in 1285 bytes} [Tue Aug 2 10:10:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:10:20.706140 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-9fab1110-9d99-4233-8363-e3b3b1a28a56 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:10:20.713767 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-9fab1110-9d99-4233-8363-e3b3b1a28a56 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011392 Aug 02 10:10:20.714319 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 35/68] 10.222.0.82 () {60 vars in 1282 bytes} [Tue Aug 2 10:10:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:13:56.286763 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:56.287812 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 02 10:13:56.288211 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 34/69] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:56.429392 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_api:SELECT=6 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:56.596350 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-62bdc761-5422-494c-aa6b-f6900ac6aff7 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:56.598760 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:13:56.598760 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: warnings.warn(msg) Aug 02 10:13:56.599975 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-62bdc761-5422-494c-aa6b-f6900ac6aff7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:13:56.600417 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-62bdc761-5422-494c-aa6b-f6900ac6aff7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:13:56.601202 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-62bdc761-5422-494c-aa6b-f6900ac6aff7 admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:13:56.601839 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-62bdc761-5422-494c-aa6b-f6900ac6aff7 admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:13:56.636630 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-62bdc761-5422-494c-aa6b-f6900ac6aff7 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208683 Aug 02 10:13:56.637201 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 36/70] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Aug 2 10:13:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:13:57.475203 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:57.476204 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 02 10:13:57.476600 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 35/71] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:13:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:13:57.672778 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-ceda80cc-ae87-4b09-ab3f-4c3d5cf034c9 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:13:57.675220 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:13:57.675220 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: warnings.warn(msg) Aug 02 10:13:57.676452 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-ceda80cc-ae87-4b09-ab3f-4c3d5cf034c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:13:57.676888 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-ceda80cc-ae87-4b09-ab3f-4c3d5cf034c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:13:57.677673 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-ceda80cc-ae87-4b09-ab3f-4c3d5cf034c9 admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:13:57.678129 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-ceda80cc-ae87-4b09-ab3f-4c3d5cf034c9 admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:13:57.697636 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-ceda80cc-ae87-4b09-ab3f-4c3d5cf034c9 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077468 Aug 02 10:13:57.698161 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 37/72] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Aug 2 10:13:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:14:08.932804 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:08.934347 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 02 10:14:08.934747 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 36/73] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:09.078157 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_cell0:SELECT=4 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:09.078865 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_cell1:SELECT=4 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:09.079537 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG dbcounter [-] [103435] Writing DB stats nova_api:SELECT=8 {{(pid=103435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:09.127894 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-99cd00ed-92c8-4adc-a35a-d0872c2ff6d6 admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:09.130379 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:14:09.130379 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: warnings.warn(msg) Aug 02 10:14:09.131562 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-99cd00ed-92c8-4adc-a35a-d0872c2ff6d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:14:09.132000 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-99cd00ed-92c8-4adc-a35a-d0872c2ff6d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:14:09.132815 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-99cd00ed-92c8-4adc-a35a-d0872c2ff6d6 admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:14:09.133292 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-99cd00ed-92c8-4adc-a35a-d0872c2ff6d6 admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:14:09.160185 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-99cd00ed-92c8-4adc-a35a-d0872c2ff6d6 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087087 Aug 02 10:14:09.160763 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 38/74] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Aug 2 10:14:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:14:09.996508 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:09.997664 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-711be0ce-9271-4210-bb4f-faca5f4f9214 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Aug 02 10:14:09.998099 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 37/75] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Aug 2 10:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:14:10.191971 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG nova.api.openstack.wsgi [None req-86f07813-cf5f-489e-a191-c0f9dbde9a9a admin admin] Calling method '>' {{(pid=103435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:14:10.194343 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:14:10.194343 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: warnings.warn(msg) Aug 02 10:14:10.195540 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-86f07813-cf5f-489e-a191-c0f9dbde9a9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:14:10.196017 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-86f07813-cf5f-489e-a191-c0f9dbde9a9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:14:10.196798 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-86f07813-cf5f-489e-a191-c0f9dbde9a9a admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:14:10.197215 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: DEBUG oslo_concurrency.lockutils [None req-86f07813-cf5f-489e-a191-c0f9dbde9a9a admin admin] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:14:10.219261 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: INFO nova.api.openstack.requestlog [None req-86f07813-cf5f-489e-a191-c0f9dbde9a9a admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081043 Aug 02 10:14:10.219813 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: [pid: 103435|app: 0|req: 39/76] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Aug 2 10:14:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:15:09.540729 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: Tue Aug 2 10:15:09 2022 - graceful shutdown triggered... Aug 02 10:15:09.541316 dv-cinder-847132-4-iscsi devstack@n-api.service[103434]: Gracefully killing worker 1 (pid: 103434)... Aug 02 10:15:09.541689 dv-cinder-847132-4-iscsi devstack@n-api.service[103435]: Gracefully killing worker 2 (pid: 103435)... Aug 02 10:15:09.542486 dv-cinder-847132-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 10:15:10.541185 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: worker 1 buried after 1 seconds Aug 02 10:15:10.541751 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: worker 2 buried after 1 seconds Aug 02 10:15:10.541751 dv-cinder-847132-4-iscsi devstack@n-api.service[103433]: goodbye to uWSGI. Aug 02 10:15:10.542830 dv-cinder-847132-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 10:15:10.543874 dv-cinder-847132-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 10:15:10.546740 dv-cinder-847132-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 10:15:10.560086 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 10:15:10 2022] *** Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: nodename: dv-cinder-847132-4-iscsi Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: machine: x86_64 Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: clock source: unix Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: pcre jit disabled Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: detected number of CPU cores: 4 Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: current working directory: / Aug 02 10:15:10.562141 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: detected binary path: /usr/bin/uwsgi-core Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: your processes number limit is 47680 Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: your memory page size is 4096 bytes Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: detected max file descriptor number: 2048 Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: lock engine: pthread robust mutexes Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: thunder lock: enabled Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 10:15:10.562916 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: Python main interpreter initialized at 0x55f92044b9c0 Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: python threads support enabled Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: your server socket listen backlog is limited to 100 connections Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: your mercy for graceful operations on workers is 90 seconds Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: *** Operational MODE: preforking *** Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: *** uWSGI is running in multiple interpreter mode *** Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: spawned uWSGI master process (pid: 118020) Aug 02 10:15:10.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: spawned uWSGI worker 1 (pid: 118031, cores: 1) Aug 02 10:15:10.602980 dv-cinder-847132-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 10:15:10.604391 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: spawned uWSGI worker 2 (pid: 118032, cores: 1) Aug 02 10:15:10.604391 dv-cinder-847132-4-iscsi devstack@n-api.service[118020]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 10:15:11.273033 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:15:11.278310 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:15:12.461080 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:15:12.461080 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: from cryptography.utils import int_from_bytes Aug 02 10:15:12.461721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:15:12.461721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: from cryptography.utils import int_from_bytes Aug 02 10:15:12.489451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:15:12.489451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: from cryptography.utils import int_from_bytes Aug 02 10:15:12.490092 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:15:12.490092 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: from cryptography.utils import int_from_bytes Aug 02 10:15:14.911323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:15:14.911805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:15:14.912294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:15:14.912666 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:15:14.912924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:15:14.913330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.913659 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.914011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.914347 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.914666 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.914977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.915309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.915627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.915953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.916216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.916531 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.916853 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-4-iscsi {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.917175 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.917668 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.918014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.918925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.919237 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.919590 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.919884 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.920561 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.921965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.921965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.921965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.922291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.922512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.922802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.923912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.923912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.924165 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.924387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.924718 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-4-iscsi {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.925041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.925416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.925913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.926344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.926659 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.926968 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.927293 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.927618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.927926 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.928255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.928575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.928894 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.929214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.929517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.929855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.930595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.930595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.930809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.931112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.931360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.931669 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.931992 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.932314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.932636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.932889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.933144 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.933467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.933819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.934148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.934458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.934768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.935076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.935383 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.935687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.935991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.936296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.936612 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.936924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.937249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.937552 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.937891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.938299 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.938549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.938853 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.939192 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.939507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.939813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.940129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.940447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.940752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.941054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.941359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.941675 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.942028 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.942332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.942582 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.942883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.943187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.943512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.943815 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.944116 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.944417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.944714 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.945018 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.945322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.945654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.946054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.946369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.946673 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.946973 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.947275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.947577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.947892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.948058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:15:14.948506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.948593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:15:14.948696 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.948839 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:15:14.948939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.949210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:15:14.949311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.949490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:15:14.949920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.950257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.950425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.950603 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.950896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.950994 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.951222 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.951330 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.951534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.951642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.951862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.951958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.952167 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.952272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.952474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.952580 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.952762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.952868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.953080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.953179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.953523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.953633 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-4-iscsi {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.953710 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.953865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.954085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.954260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.954422 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.954567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.954721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.954871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955033 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955329 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955681 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955834 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.955989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.956177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.956322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.956494 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.956648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.956817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.956969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.957124 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.957277 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.957420 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.957579 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.957776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.957975 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.958131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.958275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.958454 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.958622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.958773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.958929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.959080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.959230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.959411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.959658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.959922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-4-iscsi {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.960082 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.960228 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.960381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.960540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.960692 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.960859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.961010 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.961175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.961336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.961540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.961702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.961888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.962112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.962273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.962425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.962590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.962822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.962985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.963165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.963322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.963466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.963609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.963782 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.963997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.964168 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.964322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.964466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.964616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.964846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.964998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.965672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.965847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.966012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.966173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.966318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.966469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.966613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.966763 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.966913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.967069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.967223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.967367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.967528 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.967683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.967826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.967985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.968128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.968276 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.968418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.968563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.968715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.968861 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.969011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.969162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.969331 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.969484 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.969645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.969822 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.970069 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.970235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.970386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.970536 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.970691 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.970842 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.970992 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.971135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.971277 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.971443 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.971595 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.971595 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.971868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.971868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.972149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.972304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.972448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.972596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.972747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.972891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.973040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.973202 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.973366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.973519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.973669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.973843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.973994 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.974146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.974296 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.974439 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.974588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.974732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.974888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.975041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.975194 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.975342 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.975485 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.975627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.975779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.975923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.976082 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.976227 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.976370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.976512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.976664 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.976817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.976960 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.977153 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.977320 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.977474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.977672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.977988 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.978153 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.978423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.978575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.978729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.978881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.979129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.979363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.979596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.979916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.980094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.980322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.980476 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.980627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.980769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.981514 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.981673 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.981864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.982024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.982168 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.982318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.982460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.982646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.982798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.982942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.983084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.983241 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.983398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.983542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.983694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.983846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.984007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.984151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.984295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.984449 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.984602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.984746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.984911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.985060 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.985213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.985367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.985518 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.985661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.985828 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.985979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.986121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.986281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.986445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.986597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.986764 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.986914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.987057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.987199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.987348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.987493 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.987646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.987800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.987951 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.988122 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.988273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.988443 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.988600 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.988745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.988895 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.989049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.989193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.989334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.989486 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.989639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.989909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.990061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.990206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.990502 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.990675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.990819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.990962 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.991104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.991246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.991407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.991559 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.991704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.991854 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.991854 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.992143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.992372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.992528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.992673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.992824 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.992968 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.993110 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.993271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.993416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.993567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.993717 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.993906 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.994119 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.994277 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.994431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.994587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.994739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.994890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.995043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.995186 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:15:14.995343 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.995487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.995629 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.995772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.995925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.996078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.996229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.996380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.996541 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.996696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.996852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.997003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.997156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.997306 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.997457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.997613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.997757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998342 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998496 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998806 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.998949 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.999093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.999235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.999385 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.999551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.999700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:14.999851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000848 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.000991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.001142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.001295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.001444 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.001587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.001737 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.001904 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.002969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.003997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.004139 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.004281 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.004440 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.004593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.004750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.004893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005336 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.005976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.006128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.006282 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.006426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.006584 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.006744 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.006896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007329 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007631 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007780 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.007923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.008974 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.009130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.009274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.009416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.009569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.009712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.009886 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.010048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.010209 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.010360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.010511 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.010677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.010893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.011056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.011200 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.011350 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.011506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.011664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.011820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.012505 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.012675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.012837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.012987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.013143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.013306 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.013456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.013611 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.013775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.013976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.014127 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.014294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.014500 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.014663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.014814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015178 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015806 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.015955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.016110 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.016273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.016432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.016597 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.016759 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.016939 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.017100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.017258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.017432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.017590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.017741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.017913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.018083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.018242 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.018242 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.018536 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.018685 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.018834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.019945 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.020096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.020252 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.020409 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.020658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.020825 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.021077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.021257 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.021257 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.021544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.021700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.021995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022315 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.022964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.023286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.023443 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.023594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.023772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.023972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.024132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.024132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.024132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.024577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.024743 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.024894 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.025050 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.025207 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.025368 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.025368 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.025672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.025879 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026515 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.026859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.027162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.027312 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.027495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.028246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.028246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.028559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.028721 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.028879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.028879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.029171 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.029171 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.029463 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.029629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.029820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.029989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.030158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.030309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.030467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.030630 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.030630 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.030951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.031222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.031388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.031550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.031715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.031866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032524 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032852 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.032852 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.033149 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.033306 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.033471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.033624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.033774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.033981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.034917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.035214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.035371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.035528 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.035679 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.035828 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.035984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.036143 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.036310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.036459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.036620 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.036784 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.036784 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.037087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.037238 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.037393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.037544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.037700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.037975 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.038161 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.038316 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.038476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.038476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.038775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.038938 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.039089 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.039245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.039401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.039551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.039788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.039788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.040094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.040094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.040377 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.040545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.040695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.040853 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.041004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.041154 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.041154 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.041552 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.041705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.041930 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.042086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.042237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.042397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.042560 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.042724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.042883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.043042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.043193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.043351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.043508 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.043672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.043824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044667 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.044969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.045120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.045278 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.045436 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.045595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.045755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.045960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.046127 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.047866 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.048043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.048787 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.048877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.048954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049039 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049513 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049677 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049751 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049854 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.049930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050415 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050714 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.050929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051858 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.051858 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.052903 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053082 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053248 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053411 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.053987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.054440 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.054608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.054761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.054921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.055072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.055286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.055448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.055600 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.055751 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.055909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.056069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.056232 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.056385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.056553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.056712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.056872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.057036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.057188 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.057338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.057488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.057646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.057844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058626 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.058973 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.059129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.059280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.059448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.059448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.059863 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.060052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.060207 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.060365 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.060516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.060679 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.060845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.061004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.061162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.061328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.061529 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.061766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.061984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.062136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.062294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.062445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.062639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.062639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.063059 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.063225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.063376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.063527 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.063691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.063850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064476 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064634 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.064942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.065111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.065262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.065422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.065574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.065732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.065914 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066396 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.066860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.067169 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.067330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.067489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.067640 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.067790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.067940 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.068099 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.068259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.068410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.068567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.068717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.068868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.069043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.069197 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.069355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.069514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.069672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.069842 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070793 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.070953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.071119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.071277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.071428 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.071585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.071768 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.071995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.072162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.072321 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.072474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.072474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.072776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.072934 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.073113 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.073280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.073433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.073583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.073744 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.073932 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.074085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.074235 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.074396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.075154 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.075312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.075471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.075624 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.075781 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.075944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.076104 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.076256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.076407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.076558 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.076708 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.076859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.077022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.077175 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.077332 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.077689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.077881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.078057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.078225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.078378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.078537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.078696 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.078848 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079178 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079796 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.079967 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.080138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.080297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.080455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.080606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.080757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.080920 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.081072 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.081248 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.081400 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.081557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.081710 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.081900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.082142 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.082320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.082481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.082481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.082783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.082937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.083095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.083263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.083415 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.083575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.083736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.083890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084040 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084201 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.084949 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.085108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.085259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.085410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.085569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.085720 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.085917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.086114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.086282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.086448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.086601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.086752 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.086903 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087206 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087840 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.087840 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.088129 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.088308 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.088461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.088618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.088784 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.088942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.089093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.089254 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.089414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.089566 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.089723 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.089905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.090075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.090794 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.090976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.091129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.091281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.091431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.091597 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.091749 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.091900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.092057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.092358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.092517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.092683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.092843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.092994 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.093156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.093306 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.093466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.093627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.093856 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094017 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094470 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.094954 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.095117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.095269 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.095432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.095591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.095743 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.095894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096044 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096194 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096358 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096520 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.096983 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.097144 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.097309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.097492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.097660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.097832 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.098009 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.098251 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.098413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.098608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.098761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.098911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.099073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.099234 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.099397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.099556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.099716 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.099882 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100207 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100670 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100835 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.100995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.101147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.101305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.101474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.101637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.101869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.102036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.102195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.102441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.102601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.102760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.102926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.103996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.104147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.104297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.104297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.104601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.104755 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.104905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.105063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.105215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.105372 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.105545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.105699 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.105909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.106072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.106224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.106380 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.106541 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.106700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.106858 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107171 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.107967 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.108126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.108297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.108449 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.108600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.108750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.108900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.109050 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.109215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.109374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.109528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.109689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.109881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110202 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.110934 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.111093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.111245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.111394 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.111563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.111715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.111874 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.112027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.112184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.112336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.112575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.112734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.112895 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.113049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.113199 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.113359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.113525 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.113695 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.113884 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.114043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.114194 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.114353 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.114561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.114735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.114889 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.115041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.115200 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.115350 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.115516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.115693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.115850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116303 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.116933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.121860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.122746 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.122941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.123109 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.123268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.123422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.123574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.123735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.123891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124345 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124511 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.124980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.125139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.125139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.125446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.125598 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.125749 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.125980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.126135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.126286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.126451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.126451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.126757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.126912 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.127062 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.127222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.127382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.128766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.128950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.129117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.129440 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.129593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.129751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.129954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.130118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.130271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.130271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.130577 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.130736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.130888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131197 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131358 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131510 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.131977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.132141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.132294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.132444 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.132601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.132753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.132903 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.133063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.133216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.133367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.133517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.133667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.133859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.134116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.134116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.134409 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.134567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.134718 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.136018 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.136201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.136361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.136514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.136667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.136818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.137526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.137705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.137907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.138065 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.138216 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.138368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.138535 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.138689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.138847 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139296 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.139938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.140090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.140247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.140419 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.140574 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.140726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.140876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.141204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.141378 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.141541 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.141702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.141888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.142065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.142218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.142383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.142535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.142732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.142893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143045 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143687 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143838 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.143989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.144157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.144830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.144998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.145158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.145311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.145462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.145623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.145807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.145978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.146137 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.146295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.146454 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.146615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.146803 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.146963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.147121 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.147273 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.147424 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.147584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.147735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.147893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.148052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.148602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.148768 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.148964 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.149156 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.149341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.149341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.149631 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.149631 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.150075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.150288 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.150444 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.150613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.150767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.150933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151279 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151606 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.151917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.152215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.152366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.152517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.154131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.154320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.154320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.154720 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.154877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.155041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.155204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.155367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.155527 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.155680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.155887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156202 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156518 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.156991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.157163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.157325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.157484 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.157636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.157835 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158330 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158483 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158635 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158793 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.158954 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.159130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.159291 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.159473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.159627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.159786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.159951 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.160104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.160262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.160425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.160579 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.160745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.160745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.161058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.161058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.161352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.161512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.161677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.161862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162029 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162202 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162515 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162668 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.162989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.163147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.163306 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.163466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.164237 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.164402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.164564 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.164726 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.164880 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.165041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.165194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.165348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.165519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.165679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.165875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166046 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166665 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.166988 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.167139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.167291 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.167452 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.167604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.167774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.167774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.168079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.168261 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.168422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.168677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.168930 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.169097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.169250 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.169402 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.169553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.169725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.169906 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.170060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.170212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.173905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.174502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.174672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.174852 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175186 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175491 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.175984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.176137 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.176290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.176442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.176601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.176767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.176941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177413 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177726 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.177936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.178239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.178394 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.178553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.178712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.178712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.179986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.180138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.180366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.180583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.180775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.180931 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.181096 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.181248 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.181399 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.181552 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.181718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.181926 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.182080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.182246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.182408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.182568 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.182730 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.182883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.183034 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.183198 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.183350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.183512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.183674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.183827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184333 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.184961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.185120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.185291 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.185453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.185612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.190296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.190475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.190634 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.190787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.190956 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.191110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.191262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.191421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.191573 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.191734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.191906 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.192070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.192231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.192390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.192542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.192708 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.192860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193320 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193472 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193835 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.193995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.194158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.194310 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.194469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.194632 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.194785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.194936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.195096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.195247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.196487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.196921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.197094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.197094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.200033 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.200238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.200414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.200584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.200749 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.200918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201416 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.201948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.202262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.202417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.202577 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.202729 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.202880 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.203041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.203193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.203352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.203352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.205566 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.205566 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.205994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.206153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.206313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.206466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.209032 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.209226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.209392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.209549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.209712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.209896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.210053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.210276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.210441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.210595 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.210754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.210920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.211387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.212786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.213995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.215998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.220941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.222133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.223567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.224817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.226040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.227229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.228389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.229547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.230800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.231963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:15:15.233115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:15:15.243496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO dbcounter [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Registered counter for database nova_api Aug 02 10:15:15.265575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_db.sqlalchemy.engines [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.272959 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writer thread running {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.286005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO dbcounter [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Registered counter for database nova_api Aug 02 10:15:15.307552 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_db.sqlalchemy.engines [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.314678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writer thread running {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.330932 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.context [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df30d8db-5664-49ef-9995-24fa3fa4271f(cell1) {{(pid=118032) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:15:15.335337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:15:15.338416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:15:15.339483 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:15:15.342255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:15:15.344258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO dbcounter [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Registered counter for database nova_cell0 Aug 02 10:15:15.348412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO dbcounter [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Registered counter for database nova_cell1 Aug 02 10:15:15.356297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_db.sqlalchemy.engines [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.358583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_db.sqlalchemy.engines [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.366378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writer thread running {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.366717 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writer thread running {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.372041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.context [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df30d8db-5664-49ef-9995-24fa3fa4271f(cell1) {{(pid=118031) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:15:15.376491 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:15:15.378462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:15:15.379255 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:15:15.381275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:15:15.383302 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO dbcounter [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Registered counter for database nova_cell0 Aug 02 10:15:15.387878 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO dbcounter [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Registered counter for database nova_cell1 Aug 02 10:15:15.395079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_db.sqlalchemy.engines [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.396836 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_db.sqlalchemy.engines [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.402415 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writer thread running {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.405504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writer thread running {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.514833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO dbcounter [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Registered counter for database nova_cell0 Aug 02 10:15:15.521393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_db.sqlalchemy.engines [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.525841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writer thread running {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.551816 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO dbcounter [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Registered counter for database nova_cell0 Aug 02 10:15:15.569261 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_db.sqlalchemy.engines [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:15:15.573988 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writer thread running {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:15:15.848778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: WARNING keystonemiddleware.auth_token [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:15:15.854426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: WARNING keystonemiddleware.auth_token [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:15:15.892167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: WARNING keystonemiddleware.auth_token [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:15:15.899437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: WARNING keystonemiddleware.auth_token [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:15:16.204152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: WARNING keystonemiddleware.auth_token [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:15:16.210112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: WARNING keystonemiddleware.auth_token [None req-a5cc660f-d300-4265-8144-23b0df5afaa3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:15:16.215626 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f92044b9c0 pid: 118032 (default app) Aug 02 10:15:16.243412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: WARNING keystonemiddleware.auth_token [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:15:16.250031 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: WARNING keystonemiddleware.auth_token [None req-d50b4f5b-7f7a-43c5-9db4-649ce1f2f672 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:15:16.255373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f92044b9c0 pid: 118031 (default app) Aug 02 10:15:58.795724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:58.798669 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:58.799649 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:58.801116 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:00.451111 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-93bb822e-3351-4a6c-a821-0435370c1a72 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Action: 'create', calling method: .version_select at 0x7f5c097b3ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-961523499", "metadata": {"Type": "work"}}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-93bb822e-3351-4a6c-a821-0435370c1a72 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Request method failure captured: Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 121 Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ple3nmFzZOP6gL3Hm8fxLWJZImY70uVbgbdmNgrMZjQq29EiTeCnd__FJp-L3ksBPtaQ5pdV2ErnPpJ-fFaavMWD_SsX-tu3WaqXqt5TXJQDUvuwIIP8wFT_JA_hOgMiavxFiK_CctvBaXDEwTJ5Shjn2iUDBR7GPUUTcaU_ZZiETs Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:16:00.458177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9bab6ba334404db0b6709c91b165e0bc", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: b4624993d8e94d3ba204d1f8b71f216e Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-961523499", "metadata": {"Type": "work"}}} Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: Aug 02 10:16:00.459799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-961523499', 'metadata': {'Type': 'work'}}}} Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise error Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:16:00.460786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 10:16:00.462750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 10:16:00.464120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 10:16:00.464120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:00.465077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-93bb822e-3351-4a6c-a821-0435370c1a72 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:16:00.466323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-93bb822e-3351-4a6c-a821-0435370c1a72 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.689309 Aug 02 10:16:00.467451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 1/1] 10.222.0.82 () {60 vars in 1156 bytes} [Tue Aug 2 10:15:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1692 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:16:00.484494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:00.502451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:00.507354 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:00.510412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:01.065741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d9b78a9f-ce26-439f-a81e-9a7844189ae6 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Action: 'create', calling method: .version_select at 0x7f5c097ac9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-658538175", "metadata": {"Type": "work"}}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d9b78a9f-ce26-439f-a81e-9a7844189ae6 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Request method failure captured: Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 119 Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ple3nmFzZOP6gL3Hm8fxLWJZImY70uVbgbdmNgrMZjQq29EiTeCnd__FJp-L3ksBPtaQ5pdV2ErnPpJ-fFaavMWD_SsX-tu3WaqXqt5TXJQDUvuwIIP8wFT_JA_hOgMiavxFiK_CctvBaXDEwTJ5Shjn2iUDBR7GPUUTcaU_ZZiETs Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:16:01.074465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9bab6ba334404db0b6709c91b165e0bc", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b4624993d8e94d3ba204d1f8b71f216e Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-658538175", "metadata": {"Type": "work"}}} Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: Aug 02 10:16:01.075862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-658538175', 'metadata': {'Type': 'work'}}}} Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise error Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi '0' Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:16:01.076648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 10:16:01.080253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 10:16:01.081695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 10:16:01.081695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.085349 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d9b78a9f-ce26-439f-a81e-9a7844189ae6 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:16:01.086680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d9b78a9f-ce26-439f-a81e-9a7844189ae6 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.610714 Aug 02 10:16:01.092437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 1/2] 10.222.0.82 () {60 vars in 1156 bytes} [Tue Aug 2 10:16:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 618 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:16:01.097876 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cd3e3f36-72eb-4144-9e6a-26d246c9a649 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Action: 'create', calling method: .version_select at 0x7f5c096c29d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1890224750", "metadata": {"Type": "work"}}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cd3e3f36-72eb-4144-9e6a-26d246c9a649 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Request method failure captured: Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 119 Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ple3nmFzZOP6gL3Hm8fxLWJZImY70uVbgbdmNgrMZjQq29EiTeCnd__FJp-L3ksBPtaQ5pdV2ErnPpJ-fFaavMWD_SsX-tu3WaqXqt5TXJQDUvuwIIP8wFT_JA_hOgMiavxFiK_CctvBaXDEwTJ5Shjn2iUDBR7GPUUTcaU_ZZiETs Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:16:01.102328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9bab6ba334404db0b6709c91b165e0bc", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: b4624993d8e94d3ba204d1f8b71f216e Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1890224750", "metadata": {"Type": "work"}}} Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: Aug 02 10:16:01.103834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1890224750', 'metadata': {'Type': 'work'}}}} Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise error Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi '' Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:16:01.104726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 10:16:01.116053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 10:16:01.119185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 10:16:01.119185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.119185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cd3e3f36-72eb-4144-9e6a-26d246c9a649 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:16:01.119185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cd3e3f36-72eb-4144-9e6a-26d246c9a649 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016814 Aug 02 10:16:01.119185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 2/3] 10.222.0.82 () {60 vars in 1156 bytes} [Tue Aug 2 10:16:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:16:01.127638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-37741226-9371-42f8-b485-2ac5127f9757 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Calling method '.version_select at 0x7f5c097ac9d0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:01.722172 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-37741226-9371-42f8-b485-2ac5127f9757 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] HTTP exception thrown: Volume tempest-invalid-1880127914 could not be found. Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-37741226-9371-42f8-b485-2ac5127f9757 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Request method failure captured: Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1880127914 HTTP/1.1 Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ple3nmFzZOP6gL3Hm8fxLWJZImY70uVbgbdmNgrMZjQq29EiTeCnd__FJp-L3ksBPtaQ5pdV2ErnPpJ-fFaavMWD_SsX-tu3WaqXqt5TXJQDUvuwIIP8wFT_JA_hOgMiavxFiK_CctvBaXDEwTJ5Shjn2iUDBR7GPUUTcaU_ZZiETs Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:16:01.726532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9bab6ba334404db0b6709c91b165e0bc", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b4624993d8e94d3ba204d1f8b71f216e Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Volume tempest-invalid-1880127914 could not be found. Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'tempest-invalid-1880127914'} Aug 02 10:16:01.727843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1880127914 could not be found. (HTTP 404) (Request-ID: req-8b289bc1-dfdd-4e29-b260-cd7f05e9f9ce) Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.728641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:16:01.731492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1880127914 could not be found. Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:16:01.734272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1880127914 could not be found. Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1880127914 could not be found. Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-37741226-9371-42f8-b485-2ac5127f9757 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Returning 404 to user: Volume tempest-invalid-1880127914 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:16:01.738762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-37741226-9371-42f8-b485-2ac5127f9757 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1880127914" status: 404 len: 99 microversion: 2.1 time: 0.611566 Aug 02 10:16:01.740423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 2/4] 10.222.0.82 () {58 vars in 1218 bytes} [Tue Aug 2 10:16:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1880127914 => generated 99 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 10:16:01.744734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5a8417c4-c774-4216-b5b5-358c87684480 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006984 Aug 02 10:16:01.746142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 3/5] 10.222.0.82 () {58 vars in 1140 bytes} [Tue Aug 2 10:16:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 10:16:01.768257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3c43c2ba-9346-43ee-a2ea-4b6eb145ac99 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008330 Aug 02 10:16:01.770122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 3/6] 10.222.0.82 () {58 vars in 1137 bytes} [Tue Aug 2 10:16:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 10:16:01.779963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f0a71e09-4f95-403b-875f-c898bd545f19 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Calling method '.version_select at 0x7f5c09682ca0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:02.123776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-f0a71e09-4f95-403b-875f-c898bd545f19 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] HTTP exception thrown: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f0a71e09-4f95-403b-875f-c898bd545f19 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Request method failure captured: Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/os-volumes/924e5724-c76f-4bf4-878c-4cb935d31570 HTTP/1.1 Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ple3nmFzZOP6gL3Hm8fxLWJZImY70uVbgbdmNgrMZjQq29EiTeCnd__FJp-L3ksBPtaQ5pdV2ErnPpJ-fFaavMWD_SsX-tu3WaqXqt5TXJQDUvuwIIP8wFT_JA_hOgMiavxFiK_CctvBaXDEwTJ5Shjn2iUDBR7GPUUTcaU_ZZiETs Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:16:02.129277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9bab6ba334404db0b6709c91b165e0bc", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: b4624993d8e94d3ba204d1f8b71f216e Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '924e5724-c76f-4bf4-878c-4cb935d31570'} Aug 02 10:16:02.131046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. (HTTP 404) (Request-ID: req-e03e0736-2337-47ce-836d-cfbd1e4946f2) Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:02.131901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:16:02.133895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 10:16:02.135922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f0a71e09-4f95-403b-875f-c898bd545f19 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Returning 404 to user: Volume 924e5724-c76f-4bf4-878c-4cb935d31570 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:16:02.137382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f0a71e09-4f95-403b-875f-c898bd545f19 tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/924e5724-c76f-4bf4-878c-4cb935d31570" status: 404 len: 109 microversion: 2.1 time: 0.355776 Aug 02 10:16:02.142125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:16:01 2022] DELETE /compute/v2.1/os-volumes/924e5724-c76f-4bf4-878c-4cb935d31570 => generated 109 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:16:02.143857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-202638f8-50e1-4e5d-ac1e-aeebc8c118eb tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Calling method '.version_select at 0x7f5c09fbc1f0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:02.210234 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-202638f8-50e1-4e5d-ac1e-aeebc8c118eb tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] HTTP exception thrown: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-202638f8-50e1-4e5d-ac1e-aeebc8c118eb tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Request method failure captured: Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/os-volumes/29f76605-cc0e-4103-bdfb-9805da5620e3 HTTP/1.1 Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ple3nmFzZOP6gL3Hm8fxLWJZImY70uVbgbdmNgrMZjQq29EiTeCnd__FJp-L3ksBPtaQ5pdV2ErnPpJ-fFaavMWD_SsX-tu3WaqXqt5TXJQDUvuwIIP8wFT_JA_hOgMiavxFiK_CctvBaXDEwTJ5Shjn2iUDBR7GPUUTcaU_ZZiETs Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:16:02.212309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9bab6ba334404db0b6709c91b165e0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9bab6ba334404db0b6709c91b165e0bc", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9bab6ba334404db0b6709c91b165e0bc Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-VolumesNegativeTest-818398909 Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b4624993d8e94d3ba204d1f8b71f216e Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-VolumesNegativeTest-818398909-project Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '29f76605-cc0e-4103-bdfb-9805da5620e3'} Aug 02 10:16:02.214076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. (HTTP 404) (Request-ID: req-9acdc60f-9aa1-480a-b947-dcec1b541b19) Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:02.215140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:16:02.217215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:16:02.218421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-202638f8-50e1-4e5d-ac1e-aeebc8c118eb tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] Returning 404 to user: Volume 29f76605-cc0e-4103-bdfb-9805da5620e3 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-202638f8-50e1-4e5d-ac1e-aeebc8c118eb tempest-VolumesNegativeTest-818398909 tempest-VolumesNegativeTest-818398909-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/29f76605-cc0e-4103-bdfb-9805da5620e3" status: 404 len: 109 microversion: 2.1 time: 0.075191 Aug 02 10:16:02.219618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 4/8] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:16:02 2022] GET /compute/v2.1/os-volumes/29f76605-cc0e-4103-bdfb-9805da5620e3 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:16:03.788127 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0f630b66-df2e-4dfd-882e-8a84038bd7ee tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095bc8b0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:03.856356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0f630b66-df2e-4dfd-882e-8a84038bd7ee tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/314db9a0-0256-415a-a54f-ffc5a1a4c28e" status: 200 len: 350 microversion: 2.1 time: 0.072851 Aug 02 10:16:03.857095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 5/9] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:16:03 2022] GET /compute/v2.1/os-volumes/314db9a0-0256-415a-a54f-ffc5a1a4c28e => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:05.707348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e14058fd-14c9-4529-b097-c5d202080c0d tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095b98b0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:05.804552 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e14058fd-14c9-4529-b097-c5d202080c0d tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/5cfd5cd1-c0a0-4043-bcca-be81978b7d4f" status: 200 len: 351 microversion: 2.1 time: 0.101701 Aug 02 10:16:05.805239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 5/10] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:16:05 2022] GET /compute/v2.1/os-volumes/5cfd5cd1-c0a0-4043-bcca-be81978b7d4f => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:07.644410 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-13e31ef8-ba9a-4487-abf1-98eb94f6c0e5 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095d6040>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:07.810004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-13e31ef8-ba9a-4487-abf1-98eb94f6c0e5 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/fa848426-5439-44d6-939d-f4f7f1701afe" status: 200 len: 351 microversion: 2.1 time: 0.170931 Aug 02 10:16:07.810979 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 6/11] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:16:07 2022] GET /compute/v2.1/os-volumes/fa848426-5439-44d6-939d-f4f7f1701afe => generated 351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:07.823543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c62fa3fb-c25a-484c-8654-0cbeb966f880 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095c5670>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:08.136837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c62fa3fb-c25a-484c-8654-0cbeb966f880 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.317111 Aug 02 10:16:08.140330 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 6/12] 10.222.0.82 () {58 vars in 1134 bytes} [Tue Aug 2 10:16:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:08.159549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bc57c0ca-7f68-40ea-8a97-f99961da5627 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095bcb80>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:08.400109 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bc57c0ca-7f68-40ea-8a97-f99961da5627 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.248910 Aug 02 10:16:08.409198 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 7/13] 10.222.0.82 () {58 vars in 1149 bytes} [Tue Aug 2 10:16:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:08.423131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0a332421-4ffc-42e4-b658-5acab892d4fe tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c09fbc160>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:08.689046 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0a332421-4ffc-42e4-b658-5acab892d4fe tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.272813 Aug 02 10:16:08.689715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 7/14] 10.222.0.82 () {58 vars in 1134 bytes} [Tue Aug 2 10:16:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:08.702955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b1b421a3-c9f9-4921-a97f-0f5e754f35b9 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095d4430>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:09.035070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b1b421a3-c9f9-4921-a97f-0f5e754f35b9 tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.335852 Aug 02 10:16:09.035685 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 8/15] 10.222.0.82 () {58 vars in 1167 bytes} [Tue Aug 2 10:16:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:16:09.049729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fbdabcd5-219f-472f-9e8f-03eb9621052b tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095d8670>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:09.337167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fbdabcd5-219f-472f-9e8f-03eb9621052b tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.291651 Aug 02 10:16:09.337971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 9/16] 10.222.0.82 () {58 vars in 1170 bytes} [Tue Aug 2 10:16:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:09.353205 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8a002ab1-7702-4eca-a67b-d39cf9f2253b tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c09711700>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:09.461581 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-822091822", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "networks": [{"uuid": "47b483a2-dcb8-40ed-85c7-256805485bdd"}]}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:09.578241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8a002ab1-7702-4eca-a67b-d39cf9f2253b tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.229804 Aug 02 10:16:09.586775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 10/17] 10.222.0.82 () {58 vars in 1155 bytes} [Tue Aug 2 10:16:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:09.594208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1bb72b8f-d89b-44e6-b602-c09c7c5b3dae tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095f1160>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:09.753688 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] validate_networks() for [('47b483a2-dcb8-40ed-85c7-256805485bdd', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:16:09.874123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1bb72b8f-d89b-44e6-b602-c09c7c5b3dae tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.285939 Aug 02 10:16:09.874859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 11/18] 10.222.0.82 () {58 vars in 1188 bytes} [Tue Aug 2 10:16:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:16:09.889166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-825f1507-8345-4dfb-b6ef-7274d376083c tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] Calling method '.version_select at 0x7f5c095d8700>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:10.139953 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-825f1507-8345-4dfb-b6ef-7274d376083c tempest-VolumesTestJSON-1485437148 tempest-VolumesTestJSON-1485437148-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.255369 Aug 02 10:16:10.141170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 12/19] 10.222.0.82 () {58 vars in 1155 bytes} [Tue Aug 2 10:16:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:13.362540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6602e4c1-1081-4a61-8699-91c4845014b9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: .version_select at 0x7f5c09894b80>, body: {"keypair": {"name": "tempest-keypair-619422745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGkKsYTdiDt33ahMJPQmfa0ZSJLTKqLvj4z3wYwW8hIjOF+Ky3LjeKAqnsDucQMxBB1MCBapfREptbh/C8VVI03xEW6Z/BfEmuDYURD7bTfg6rsp7IhNtO8DsIsfBN8nQ=="}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:13.473652 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-6602e4c1-1081-4a61-8699-91c4845014b9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:13.482764 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-6602e4c1-1081-4a61-8699-91c4845014b9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for user e881ae7c60254c12860fff0a40480641 and project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:13.566202 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6602e4c1-1081-4a61-8699-91c4845014b9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.438238 Aug 02 10:16:13.574453 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 13/20] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:16:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:13.949275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:16:13.949734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:16:13.950235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:16:13.950648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:16:13.951309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:16:13.982004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:13.982569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:13.983719 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:13.984253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:14.067287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Getting quotas for project 088b96c6fcf64d899fbbe739c682de7d. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:14.076504 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Getting quotas for user f690a9da98b548e9aee69426281ae428 and project 088b96c6fcf64d899fbbe739c682de7d. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:14.099116 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:16:14.103646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:16:14.262151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d725d55d-829c-4689-894f-58fc63fce0bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.580329 Aug 02 10:16:14.264026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 8/21] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:16:14.276408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d97113c6-8f6b-40c0-b231-f0a648a00e8c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:14.277147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d97113c6-8f6b-40c0-b231-f0a648a00e8c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:14.581411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d97113c6-8f6b-40c0-b231-f0a648a00e8c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:14.610487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d97113c6-8f6b-40c0-b231-f0a648a00e8c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1214 microversion: 2.1 time: 0.335618 Aug 02 10:16:14.612326 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 14/22] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:14 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:15.636223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0c2510d9-d8bb-4ad2-bfac-07af4c5a80bd tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:15.636852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0c2510d9-d8bb-4ad2-bfac-07af4c5a80bd tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:16.121537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0c2510d9-d8bb-4ad2-bfac-07af4c5a80bd tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:16.159555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0c2510d9-d8bb-4ad2-bfac-07af4c5a80bd tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1214 microversion: 2.1 time: 0.528124 Aug 02 10:16:16.160901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 9/23] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:15 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1214 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:17.183417 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:17.184800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:17.196126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:17.196769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:17.197586 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:17.203592 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:17.897213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:17.931376 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4fdc3ce8-afd8-407e-9677-41bc5dbf262c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1210 microversion: 2.1 time: 0.745293 Aug 02 10:16:17.947742 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 15/24] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:17 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1210 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:18.971269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:18.974535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:19.013332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:19.016042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:19.017128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:19.019928 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:19.383847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:19.417491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-091d3bbe-733e-49e0-ab42-1b716a07fd35 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1210 microversion: 2.1 time: 0.464067 Aug 02 10:16:19.421177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 10/25] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:18 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1210 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:20.441820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:20.448080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:20.461542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:20.470558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:20.473728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:20.474414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:20.750948 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:20.801542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-884983a5-0d69-4d68-8f4e-51ec3eea30bc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1210 microversion: 2.1 time: 0.361942 Aug 02 10:16:20.802899 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 16/26] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:20 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1210 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:21.360974 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a0ece59b-21a2-4e44-b64d-aa9768ab44d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'create', calling method: .version_select at 0x7f5c08400a60>, body: {"keypair": {"name": "tempest-keypair-1240802145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPt0r2nZedo+Ryp2szAKlWEiwEJ3FIC3Yw19Es2XOR88dI8pOZR1pHYuQqn57L2e2xdLlNrtO2pnTZO437RTHP4B8rx1pjMICSJ3IS2HHnBiFRYAGgX1TT1HSGc0sXyKw=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:21.437377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-a0ece59b-21a2-4e44-b64d-aa9768ab44d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for project 23714720faaa4562b694d7e3fbda2c33. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:21.452605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-a0ece59b-21a2-4e44-b64d-aa9768ab44d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for user b6890a8127e04092920cb1d31ab56d91 and project 23714720faaa4562b694d7e3fbda2c33. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:21.549593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a0ece59b-21a2-4e44-b64d-aa9768ab44d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.629247 Aug 02 10:16:21.550171 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 11/27] 10.222.0.82 () {62 vars in 1200 bytes} [Tue Aug 2 10:16:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 631 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 10:16:21.823490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:21.824198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:21.833729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:21.838708 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:21.841651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:21.866322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:22.226434 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1108651002", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09afbed8-6c5a-4ce3-a467-c8db3af43e1e"}], "security_groups": [{"name": "tempest-securitygroup--30543191"}], "key_name": "tempest-keypair-619422745", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:22.242491 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:22.252895 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-31d22de7-7b16-4285-afbf-787556b3d438 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1210 microversion: 2.1 time: 0.433483 Aug 02 10:16:22.254715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 17/28] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:21 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1210 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:22.477367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] validate_networks() for [('09afbed8-6c5a-4ce3-a467-c8db3af43e1e', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:16:23.277240 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:23.280641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:23.322493 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:23.326418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:23.329703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:23.330223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:23.860063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:23.876358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3264f40a-0af9-49c9-aff2-4988b9976976 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1272 microversion: 2.1 time: 0.605180 Aug 02 10:16:23.877394 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 18/29] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:23 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1272 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:24.027939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:24.644265 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:16:24.644748 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:16:24.645854 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:16:24.647169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:16:24.647169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:16:24.693552 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:24.698662 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:24.705313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:24.708459 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:24.751375 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:24.833559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:24.853813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for user e881ae7c60254c12860fff0a40480641 and project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:24.920791 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:16:24.929918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:16:25.224846 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7749ed59-4d10-4e25-a61b-fb0bcf488e9d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.005255 Aug 02 10:16:25.249030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 12/30] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:16:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 3024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:16:25.293243 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:25.301306 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:25.361547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:25.362391 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:25.377084 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:25.379738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:25.777055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1492160884", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:26.096702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] validate_networks() for [('af65931f-804a-4097-ad31-d27fcf02711b', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:16:26.589615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:26.630636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-86de1c18-5d97-4c2b-9e60-eecf68073283 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1272 microversion: 2.1 time: 1.350372 Aug 02 10:16:26.635010 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 13/31] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:25 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1272 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:26.653770 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-904508ff-d2b4-4455-9d55-8c71a5dc5ff3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:26.667013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-904508ff-d2b4-4455-9d55-8c71a5dc5ff3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:27.122871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-904508ff-d2b4-4455-9d55-8c71a5dc5ff3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:27.138658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-904508ff-d2b4-4455-9d55-8c71a5dc5ff3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1237 microversion: 2.1 time: 0.497165 Aug 02 10:16:27.147331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 14/32] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:26 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1237 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:27.176650 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1512165197", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1aeea0cf-13aa-4672-aaac-8b83f3820caa"}], "security_groups": [{"name": "tempest-securitygroup--1909307799"}], "key_name": "tempest-keypair-1240802145", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:27.690262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] validate_networks() for [('1aeea0cf-13aa-4672-aaac-8b83f3820caa', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:16:29.603596 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:16:29.604162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:16:29.604866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:16:29.605525 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:16:29.606565 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:16:29.631892 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.632590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.633884 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.634519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.667180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for project ce6b9eda623740608e0c9998aaa74dab. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:29.672958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:16:29.673650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for user 99616b362eac4b7dba445dafd3ca1426 and project ce6b9eda623740608e0c9998aaa74dab. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:29.675428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:16:29.676707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:16:29.677453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:16:29.678075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:16:29.691109 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.691748 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.692801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.693255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.704991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:16:29.709396 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:16:29.734891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for project 23714720faaa4562b694d7e3fbda2c33. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:29.749752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for user b6890a8127e04092920cb1d31ab56d91 and project 23714720faaa4562b694d7e3fbda2c33. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:29.777126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:16:29.801988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:16:29.831522 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-332b9d32-9188-4c83-9fd8-ea0442664b2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.088183 Aug 02 10:16:29.832803 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 19/33] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:16:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 5090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:16:29.839101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:29.841621 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:29.850322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.852391 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.856418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.857933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.942000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-99c67137-62ee-463a-bf6e-75e405abbd58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.790577 Aug 02 10:16:29.945622 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 15/34] 10.222.0.82 () {62 vars in 1188 bytes} [Tue Aug 2 10:16:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 10:16:29.955523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:29.962971 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:29.982559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.985190 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:29.986141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:29.989171 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:30.199625 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:30.214166 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6b2e3a8c-efd8-4eb4-be37-6bc5a1453ff8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1233 microversion: 2.1 time: 0.265132 Aug 02 10:16:30.214896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 16/35] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:29 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1233 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:30.236334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0958afb4-1f0d-454b-8d3d-ab9c52557f4b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:30.237131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0958afb4-1f0d-454b-8d3d-ab9c52557f4b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:30.355665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0958afb4-1f0d-454b-8d3d-ab9c52557f4b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:30.368274 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0958afb4-1f0d-454b-8d3d-ab9c52557f4b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1222 microversion: 2.1 time: 0.150186 Aug 02 10:16:30.375151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 17/36] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:30 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:30.391914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:30.394865 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7f9c8915-324a-40e8-a679-60024095f282 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:30.395929 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7f9c8915-324a-40e8-a679-60024095f282 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:30.401450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-374a23f9-39da-4f25-901e-926d71450db8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.566867 Aug 02 10:16:30.402225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 20/37] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:29 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:30.529570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7f9c8915-324a-40e8-a679-60024095f282 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:30.547457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7f9c8915-324a-40e8-a679-60024095f282 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:30.550957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7f9c8915-324a-40e8-a679-60024095f282 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:30.554836 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7f9c8915-324a-40e8-a679-60024095f282 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1282 microversion: 2.20 time: 0.172310 Aug 02 10:16:30.556064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 18/38] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:30 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:30.636913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1296475753", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:30.702719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] validate_networks() for [('af65931f-804a-4097-ad31-d27fcf02711b', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:16:31.235628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:31.236245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:31.247328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.248142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.249408 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.250103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.333674 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:31.341989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5d68eae4-1c67-4618-b1bb-1bb4cf35186d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1233 microversion: 2.1 time: 0.110004 Aug 02 10:16:31.343260 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 19/39] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:31 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:31.356434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:16:31.356869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:16:31.357422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:16:31.357757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:16:31.358197 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:16:31.369185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.369637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.370479 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.370924 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.392036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for project ce6b9eda623740608e0c9998aaa74dab. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:16:31.396490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for user 99616b362eac4b7dba445dafd3ca1426 and project ce6b9eda623740608e0c9998aaa74dab. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:16:31.409281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:16:31.412824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:16:31.433089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:31.433837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:31.445293 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.446143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.447289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.447999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.477120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5240950e-52f7-4fe4-8a01-b70ddc4416a6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.845170 Aug 02 10:16:31.480353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 21/40] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:16:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:16:31.491890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6d84c936-e04a-4ca1-96c7-781405fb3eeb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:31.492574 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6d84c936-e04a-4ca1-96c7-781405fb3eeb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:31.598865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6d84c936-e04a-4ca1-96c7-781405fb3eeb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:31.606951 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6d84c936-e04a-4ca1-96c7-781405fb3eeb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1222 microversion: 2.1 time: 0.118911 Aug 02 10:16:31.607959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 22/41] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:31 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:31.613358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:31.614211 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:31.626716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.627569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.630173 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:31.630864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:31.734918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:31.736758 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:31.748253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d828cfc4-5c33-462d-b833-5825d20b69ce tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.320731 Aug 02 10:16:31.748842 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 20/42] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:31 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:31.753755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:31.755883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:31.757441 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5a7bfc91-220f-435a-988d-7e62a21d2924 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.148260 Aug 02 10:16:31.766689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 23/43] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:31 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:32.363724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:32.364333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:32.371726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.372215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.372993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.373430 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.494704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:32.509972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b974f202-521f-4efe-a9f8-6e3d9ca7e3e4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.150394 Aug 02 10:16:32.511079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 21/44] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:32 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:32.632314 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:32.632943 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:32.661032 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.673327 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.674543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.676254 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.770085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:32.770716 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:32.784376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.808036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.810355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.811123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.864153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:32.891997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f33c7a8c-df38-40e2-a771-6258f37e4932 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.262262 Aug 02 10:16:32.897883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 24/45] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:32 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:32.925481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:32.925481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:32.936829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.937293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:32.938874 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:32.939756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:33.124283 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:33.157673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:33.164638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:33.175513 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4cfcacb6-c01a-4eb0-b4b7-716894aae874 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.270109 Aug 02 10:16:33.201880 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 25/46] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:32 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:33.267027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:33.287197 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-055ac848-f122-47d1-ae8a-d3c0612272bb tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.510283 Aug 02 10:16:33.302828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 22/47] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:32 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:33.533016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:33.533633 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:33.539689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:33.540348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:33.541548 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:33.542060 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:33.633318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:33.642702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e71ee7c5-4121-4ad2-aafd-22a71aee1893 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.113497 Aug 02 10:16:33.643273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 26/48] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:33 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:33.916907 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:33.917649 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:33.924474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:33.924941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:33.925723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:33.926226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:33.991393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:33.998799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e1550c28-fcbe-4706-aad7-99d478e6f1c6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.085915 Aug 02 10:16:33.999386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 23/49] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:33 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:34.208006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:34.208756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:34.216142 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:34.216771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:34.217949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:34.218713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:34.291372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:34.299869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:34.301950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:34.303256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-70ba0b41-9539-421a-b961-f40841149ad6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.100036 Aug 02 10:16:34.317811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 27/50] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:34 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:34.326150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:34.327465 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:34.335322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:34.335969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:34.336943 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:34.337387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:34.564811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:34.572965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c24067cc-ea03-4ead-8d1c-1c2beab79a95 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.253040 Aug 02 10:16:34.585923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 24/51] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:34 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:34.665837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:34.666738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:34.683458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:34.683912 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:34.685654 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:34.686259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:34.754022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:34.763645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d8202639-1d93-4e71-81b3-6dd0e52455f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.101730 Aug 02 10:16:34.764946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 28/52] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:34 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:35.042609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:35.042609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:35.042609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:35.059559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.060226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.064693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.066175 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.176984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:35.186302 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ed2041dc-5589-40c2-9d26-51c531db00f8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.158264 Aug 02 10:16:35.187684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 25/53] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:35 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:35.330867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:35.331610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:35.337866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.338591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.339551 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.339984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.414840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:35.423903 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:35.425747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:35.427452 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-15563ad8-ddc5-42cc-a9bd-46eb84d0f042 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.100414 Aug 02 10:16:35.428609 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 29/54] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:35 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:35.596010 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:35.596640 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:35.602958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.603401 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.604957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.605741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.784870 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:35.785482 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:35.792156 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.792828 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.793610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:35.794669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:35.829767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:35.837751 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-93201441-10c1-4294-b4d8-8f40038ac549 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.245784 Aug 02 10:16:35.838458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 26/55] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:35 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:35.862887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:35.870529 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-122dfa05-ddf6-4e02-a4a3-0c4c4a794135 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.089411 Aug 02 10:16:35.871098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 30/56] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:35 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:36.212022 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:36.213072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:36.229357 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.229853 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.230644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.231081 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.315819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:36.324436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e33cf828-66f3-4c40-a32b-4f0e435f08ce tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.116731 Aug 02 10:16:36.325146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 27/57] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:36 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:36.453061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:36.454113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:36.460496 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.460882 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.461640 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.462497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.541725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:36.550356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:36.552413 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:36.553764 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-88ffab7c-8d6b-4445-9e59-9024794b6f4c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.105178 Aug 02 10:16:36.554337 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 31/58] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:36 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:36.861879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:36.862854 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:36.880607 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.881368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.882661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.883099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.894873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:36.895495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:36.904018 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.904706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:36.905917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:36.906468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:37.032302 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:37.047800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-42ebf7c5-c2d1-48b0-8649-c87e8e172f5c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.158713 Aug 02 10:16:37.061907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 32/59] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:36 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:37.134408 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:37.143705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-831b3183-60e9-46ff-b76a-fdf6946e4ee9 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.287668 Aug 02 10:16:37.144287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 28/60] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:36 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:37.344280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:37.344789 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:37.350820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:37.351273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:37.352061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:37.352495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:37.413961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:37.417445 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:37.423097 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7ac4f309-f634-46d2-817e-782e17b43c1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.082705 Aug 02 10:16:37.423679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 33/61] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:37 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:37.576762 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:37.577406 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:37.584247 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:37.585069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:37.586081 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:37.587035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:37.669762 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:37.681337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:37.685876 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:37.690395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6075b05d-f9f9-46f6-b448-deb4af4f3ab2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.117561 Aug 02 10:16:37.691077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 29/62] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:37 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:38.068591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:38.069170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:38.075215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.075683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.076430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.076865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.137832 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:38.145273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-634483b7-4a5c-43f5-acfc-0d5a2a0b48fd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.080658 Aug 02 10:16:38.145856 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 34/63] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:38 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:38.164300 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:38.164911 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:38.171674 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.172158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.172917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.173351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.312344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:38.319995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-54701ff8-2287-497f-aa8d-e4850a6c3e61 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.159365 Aug 02 10:16:38.320453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 30/64] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:38 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:38.444830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:38.445450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:38.453647 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.454130 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.454913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.455350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.530532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:38.538291 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f0b935d3-a9bf-4818-a9ad-57c89debb28f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.097622 Aug 02 10:16:38.539519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 35/65] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:38 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:38.715409 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:38.717462 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:38.723772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.724219 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.724983 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:38.725413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:38.752857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:38.799608 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:38.808983 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:38.810656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:38.811901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-86c8c5aa-c0f3-4cb5-bb50-8732cc314df3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.102268 Aug 02 10:16:38.812466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 31/66] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:38 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:39.166247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:39.166872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:39.173367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.173850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.174619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.175053 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.262670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:39.270537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-11a64a7f-de2f-44b5-938c-1e65ac6dde94 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.108078 Aug 02 10:16:39.271102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 36/67] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:39 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:39.341510 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:39.342155 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:39.348759 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.349287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.350156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.350683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.519821 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:39.527732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-107306ca-3075-47e6-bb25-a99f51e56857 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.190917 Aug 02 10:16:39.528894 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 32/68] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:39 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:39.562794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:39.563471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:39.570201 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.570657 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.571447 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.571890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.674470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:39.682084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9a786ec0-72f6-4b0a-9ffb-debe6ae8a1ac tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.125118 Aug 02 10:16:39.682961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 37/69] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:39 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:39.835212 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:39.835965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:39.838221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=4 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:39.844527 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.844975 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.845881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:39.850606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:39.921771 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:39.934063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:39.936072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:39.937523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-960b3026-f790-4b02-a474-1223557ef7d1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.106714 Aug 02 10:16:39.938581 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 33/70] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:39 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:40.290705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:40.291166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:40.297572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.298128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.299068 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.299569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.365533 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:40.373582 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d43408a8-88c2-4916-9766-a8a269a74fad tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.087168 Aug 02 10:16:40.374178 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 38/71] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:40 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:40.550571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:40.551101 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:40.553188 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=30 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:40.558766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.559215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.560634 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.561072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.695594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:40.703907 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b6da804d-edcb-4d25-944e-febbf1a231c8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.157270 Aug 02 10:16:40.704350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:40.704480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 34/72] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:40 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:40.705298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:40.711624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.712249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.713260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.713809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.785759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:40.796647 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-49263d57-89e6-4b78-8a02-c2c7dadc5d30 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.096198 Aug 02 10:16:40.797204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 39/73] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:40 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:40.962231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:40.962972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:40.975889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.979873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:40.980676 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:40.981118 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.046400 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:41.054792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:41.056295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:41.057400 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ee915e78-bcb7-42b6-b03b-1d29707526ed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.099224 Aug 02 10:16:41.057969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 35/74] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:40 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:41.394601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:41.395810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:41.397805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=4 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:41.404171 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:41.404719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.405401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:41.406016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.472980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:41.480419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-75a5d829-93a2-44ad-a092-d810915485b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.089577 Aug 02 10:16:41.480993 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 40/75] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:41 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:41.724474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:41.725119 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:41.731335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:41.732427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.733208 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:41.733654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.817907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:41.818556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:41.821462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=14 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:41.822227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:41.826284 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:41.826759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.827556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:41.828101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:41.877106 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:41.884636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4dd0ef01-c77e-4774-ad33-d02fa0c92c15 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.164007 Aug 02 10:16:41.885655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 36/76] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:41 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:41.893196 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:41.900802 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-07ac9a3c-eb58-4639-8368-d0528dbac5b8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.087034 Aug 02 10:16:41.901483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 41/77] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:41 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:42.080862 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:42.081478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:42.088089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.088535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.089302 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.089731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.153199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:42.162009 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:42.163529 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:42.164640 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ff90f69a-a255-4b35-a298-49de6055caa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.088046 Aug 02 10:16:42.165198 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 37/78] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:42 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:42.502084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:42.502619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:42.508877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.509470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.510122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.510560 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.572627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:42.580548 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-801168a5-8262-4452-b3b6-d8bc1260078b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.082491 Aug 02 10:16:42.581107 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 42/79] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:42 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:42.905776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:42.906427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:42.912464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.912912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.913672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.914128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.922463 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:42.923078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:42.929339 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.929809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:42.930590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:42.931490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:43.020287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:43.027734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d654ca9d-4a52-4ba8-9902-cebef6cde0ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.109549 Aug 02 10:16:43.028317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 43/80] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:42 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:43.080565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:43.088043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-347d3eab-a6de-4cf6-89ad-d5f24f94bee8 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.186141 Aug 02 10:16:43.088633 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 38/81] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:42 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:43.187554 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:43.188169 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:43.194249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:43.194696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:43.195457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:43.195894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:43.257411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:43.265885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:43.267420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:43.268531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c5fd86a4-fdc7-4782-b3d0-84cad544dd24 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.084943 Aug 02 10:16:43.269286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 44/82] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:43 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:43.601538 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:43.602569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:43.609513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:43.610021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:43.610794 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:43.611232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:43.673795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:43.681594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-48c8eef2-ea71-4943-b710-cf9adf6ce07b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.083951 Aug 02 10:16:43.682200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 39/83] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:43 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:44.048547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:44.049184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:44.055513 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.055954 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.056707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.057136 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.108464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:44.109203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:44.115389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.115844 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.116613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.117059 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.117489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:44.125809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1ddf52ff-a445-45eb-8cbc-10271345062d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1226 microversion: 2.1 time: 0.081037 Aug 02 10:16:44.126409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 45/84] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:44 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:44.247923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:44.255337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-199269a2-5b02-475c-b31e-88f89e14de5e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.150714 Aug 02 10:16:44.255907 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 40/85] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:44 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:44.291683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:44.292324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:44.298974 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.299416 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.300160 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.300717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.361534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:44.369704 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:44.371243 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:44.373000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3f93edbe-888c-4e60-a152-20a9c486cf72 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1286 microversion: 2.20 time: 0.084684 Aug 02 10:16:44.373561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 46/86] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:44 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:44.701211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:44.701836 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:44.708980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.709421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.710215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:44.710646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:44.784776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:44.793859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-92db3ee7-84b6-48e2-be04-97ccd3231ac9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1289 microversion: 2.1 time: 0.096121 Aug 02 10:16:44.795174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 41/87] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:44 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:45.147008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:45.147544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:45.154438 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.154909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.155684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.156119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.256411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:45.270308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b0025b96-452e-480e-a584-aa6605491dd8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1218 microversion: 2.1 time: 0.127131 Aug 02 10:16:45.279649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 47/88] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:45 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:45.286266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:45.287057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:45.294526 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.295139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.295980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.296481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.395818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:45.396487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:45.402694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.403908 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.405146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.406392 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.503075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:45.512451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:45.514927 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:45.516648 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2216d41a-952c-4f45-af26-f72930818fa1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1334 microversion: 2.20 time: 0.124796 Aug 02 10:16:45.518339 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 48/89] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:45 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1334 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:16:45.570090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:45.579463 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9c7063c5-3600-456d-a4eb-81b9ad34a9dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.297584 Aug 02 10:16:45.580053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 42/90] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:45 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:45.820116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:45.821867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:45.836051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.836727 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.837855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:45.838707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:45.971553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:45.980873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-349e3d30-a728-415f-850d-9e09a434d828 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1307 microversion: 2.1 time: 0.167630 Aug 02 10:16:45.982826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 49/91] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:45 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:46.296069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:46.297669 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:46.312961 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.313610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.314482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.315075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.393494 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:46.402229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1b94d8a4-59b8-41d3-ba99-f6f8fd1a9ad6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1274 microversion: 2.1 time: 0.112415 Aug 02 10:16:46.402994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 43/92] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:46 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:46.437453 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-1905de6f-1beb-4428-b62b-d3d43e1c41c6 req-5919d384-ffbb-4b27-9f7b-55f26ed53ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84567e7b-e992-45ea-a416-0973e4eb6ae1", "tag": "0bc292ca-839f-4a65-83be-8d5068df550e"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:46.451023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-1905de6f-1beb-4428-b62b-d3d43e1c41c6 req-5919d384-ffbb-4b27-9f7b-55f26ed53ba8 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.451474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-1905de6f-1beb-4428-b62b-d3d43e1c41c6 req-5919d384-ffbb-4b27-9f7b-55f26ed53ba8 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.510506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-1905de6f-1beb-4428-b62b-d3d43e1c41c6 req-5919d384-ffbb-4b27-9f7b-55f26ed53ba8 service nova] Creating event network-changed:0bc292ca-839f-4a65-83be-8d5068df550e for instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 on hv-cinder-84713 Aug 02 10:16:46.511273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-1905de6f-1beb-4428-b62b-d3d43e1c41c6 req-5919d384-ffbb-4b27-9f7b-55f26ed53ba8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 10:16:46.514298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57725f45-5583-4399-8708-8a61be87202a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.520499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57725f45-5583-4399-8708-8a61be87202a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.520499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57725f45-5583-4399-8708-8a61be87202a None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.520499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57725f45-5583-4399-8708-8a61be87202a None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.527886 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:46.531078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.compute.rpcapi [None req-57725f45-5583-4399-8708-8a61be87202a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 10:16:46.532305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57725f45-5583-4399-8708-8a61be87202a None None] Releasing lock "compute-rpcapi-router" {{(pid=118031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 10:16:46.544427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:46.545502 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:46.570107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.572655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.573592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.574154 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.588662 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-57725f45-5583-4399-8708-8a61be87202a None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229394 Aug 02 10:16:46.590342 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 50/93] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:46.608130 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:46.609979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:46.620614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.621418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.622763 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:46.623207 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:46.666517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:46.682938 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:46.685880 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:46.699834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d241f3d8-9f1d-49f0-a5a8-9a54bcd4589f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1340 microversion: 2.20 time: 0.159936 Aug 02 10:16:46.702312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 44/94] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:46 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:47.009228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:47.010724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:47.056374 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:47.062093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:47.066015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:47.068373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:47.275423 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:47.299273 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b5ae0891-244a-4667-a059-e226f0357cb8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1295 microversion: 2.1 time: 0.299237 Aug 02 10:16:47.314388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 45/95] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:46 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1295 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:47.424370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:47.425676 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:47.440074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:47.440776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:47.441999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:47.442758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:47.876452 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:47.908101 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-86461ee9-1a0f-47ab-990d-981aaff315ad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1280 microversion: 2.1 time: 0.487554 Aug 02 10:16:47.937344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:47.949920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d5c44a9c-4107-49cc-8b1d-dfd9ae4b6b51 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 1.345894 Aug 02 10:16:47.951605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 46/96] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:47 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1280 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:47.962520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:47.967457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 51/97] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:46 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:47.968922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:48.005151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:48.005713 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:48.015035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:48.017322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:48.327519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:48.328244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:48.338126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:48.338779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:48.339800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:48.342194 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:48.482657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:48.496859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:48.499535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:48.501320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5b1e8062-5a90-43c8-9282-40a900ed9ae7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1340 microversion: 2.20 time: 0.547899 Aug 02 10:16:48.502223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 47/98] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:47 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1340 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:48.999151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-f6b2e392-06ba-46b8-8f97-dd456e2d8a02 req-08114c82-b4f3-4a76-9922-b8e8d3ad5af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df694e6a-8f96-4024-9f32-7fd36d7114fe", "tag": "cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:49.030287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f6b2e392-06ba-46b8-8f97-dd456e2d8a02 req-08114c82-b4f3-4a76-9922-b8e8d3ad5af4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.034473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f6b2e392-06ba-46b8-8f97-dd456e2d8a02 req-08114c82-b4f3-4a76-9922-b8e8d3ad5af4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.049676 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:49.062781 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-f6b2e392-06ba-46b8-8f97-dd456e2d8a02 req-08114c82-b4f3-4a76-9922-b8e8d3ad5af4 service nova] Creating event network-changed:cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6 for instance df694e6a-8f96-4024-9f32-7fd36d7114fe on hv-cinder-84713 Aug 02 10:16:49.063867 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f6b2e392-06ba-46b8-8f97-dd456e2d8a02 req-08114c82-b4f3-4a76-9922-b8e8d3ad5af4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 10:16:49.065378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.065717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:49.066671 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.067953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.068726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.082036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.compute.rpcapi [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 10:16:49.082458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-db955227-e591-499e-a208-7e146104a440 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.761889 Aug 02 10:16:49.083541 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] Releasing lock "compute-rpcapi-router" {{(pid=118032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 10:16:49.100344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 52/99] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:48 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:49.111651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:49.116520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-15fad309-1cfd-486f-8dcc-94304df4725a None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189611 Aug 02 10:16:49.117368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 48/100] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:16:49.120833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:49.128452 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.129280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.130414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.130894 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:49.131411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.131623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:49.142290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.142754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.143971 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.145545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.296897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:49.308819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-17eedbd3-bb1f-4b0e-9ffd-ce65672db393 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1280 microversion: 2.1 time: 0.204738 Aug 02 10:16:49.316991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 53/101] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:49 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:49.526584 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:49.528038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:49.538118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.539572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.540789 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:49.541372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:49.574600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:49.583864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-536c93fc-461a-4b9a-9205-6218edea2a21 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.464958 Aug 02 10:16:49.584453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 49/102] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:49 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:50.032105 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:50.057235 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:50.063620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:50.065007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2b4578bf-9c8c-45e7-b43a-dd3d71ac0cfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.544239 Aug 02 10:16:50.072334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 54/103] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:49 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:50.107557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:50.108426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:50.117158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:50.117944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:50.119179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:50.119935 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:50.329898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:50.339028 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:50.342036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:50.345383 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9e0af37a-07be-45d3-96de-6a72b9e960ac tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.241926 Aug 02 10:16:50.348449 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:50.349180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:50.350390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:50.351249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:50.359953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 50/104] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:50 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:50.596540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:50.608789 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-55c9a241-bd96-41d3-aea1-6660bae68cf5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.273897 Aug 02 10:16:50.609367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 55/105] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:50 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:50.610464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:50.611309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:50.623385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:50.623851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:50.624781 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:50.625250 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:50.796073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:50.803667 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4060b2d8-7cc5-4437-ba2e-c1a784199e1d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.200862 Aug 02 10:16:50.804230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 51/106] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:50 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:51.095125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:51.095826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:51.105239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.105686 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.106575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.107006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.248919 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:51.257922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:51.259657 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:51.260850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5018a3ce-578b-418a-87c0-b44fed57429b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.170200 Aug 02 10:16:51.261409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 56/107] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:51 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:51.367685 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:51.368298 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:51.374645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.375093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.376016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.376448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.534785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:51.542613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7b013d03-8435-470d-b270-4e342649efa5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.178734 Aug 02 10:16:51.543180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 52/108] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:51 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:51.629589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:51.630234 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:51.636500 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.637038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.638480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.638991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.824534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:51.825842 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:51.832267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.832796 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:51.833696 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:51.834229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:52.005434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:52.014016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2ad95677-71fb-44ea-a680-1579294d2c47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.388059 Aug 02 10:16:52.014684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 57/109] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:51 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:52.055659 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:52.064643 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-62f04212-d773-450d-8f03-bf8e8596f11a tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.244085 Aug 02 10:16:52.065227 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 53/110] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:51 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:52.287126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:52.287752 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:52.298067 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:52.298775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:52.299694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:52.301093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:52.563254 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:52.563879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:52.570960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:52.571660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:52.572446 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:52.572889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:52.862937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:52.871026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:52.872710 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:52.873871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-60c62fcb-1770-4486-aeaf-472de3b9b4a2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.592430 Aug 02 10:16:52.874752 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 58/111] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:52 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:53.035361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:53.035980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:53.039884 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:53.042695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:53.043153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:53.044359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:53.044359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:53.050169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-66456c5b-4648-4565-b95b-882c5bce179f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.490616 Aug 02 10:16:53.051083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 54/112] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:52 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:53.086456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:53.087073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:53.093417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:53.093889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:53.094662 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:53.095093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:53.483510 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:53.491500 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-48cdcc50-2709-429f-b04c-b07e0e3cb879 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.459950 Aug 02 10:16:53.492480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 59/113] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:53 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:53.581563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:53.592440 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c6d3d3ea-c319-42a8-9e3d-a5e9f1df0657 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.509764 Aug 02 10:16:53.594747 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 55/114] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:53 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:53.906191 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:53.907138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:53.916689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:53.917835 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:53.919729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:53.920375 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.071480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:54.072100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:54.079054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.079507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.080289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.080739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.466878 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:54.478360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:54.480535 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:54.484517 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4b75156e-3435-4fdb-901d-45515c0126d4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.584384 Aug 02 10:16:54.486619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 60/115] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:53 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:54.501547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-6ad500b7-1a03-4c13-8d09-1c3b02ae059e req-1e96a75a-0615-4dfa-9ef9-15c4f5accb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5864b784-67b0-4103-b4ca-1fa50804e269", "tag": "2e6932a7-2bdf-48ce-9599-52404dd3c01d"}, {"name": "network-changed", "server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:54.527575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-6ad500b7-1a03-4c13-8d09-1c3b02ae059e req-1e96a75a-0615-4dfa-9ef9-15c4f5accb12 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.528185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-6ad500b7-1a03-4c13-8d09-1c3b02ae059e req-1e96a75a-0615-4dfa-9ef9-15c4f5accb12 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.555816 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-6ad500b7-1a03-4c13-8d09-1c3b02ae059e req-1e96a75a-0615-4dfa-9ef9-15c4f5accb12 service nova] Creating event network-changed:2e6932a7-2bdf-48ce-9599-52404dd3c01d for instance 5864b784-67b0-4103-b4ca-1fa50804e269 on hv-cinder-84713 Aug 02 10:16:54.561542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-6ad500b7-1a03-4c13-8d09-1c3b02ae059e req-1e96a75a-0615-4dfa-9ef9-15c4f5accb12 service nova] Creating event network-changed:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:16:54.575035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-6ad500b7-1a03-4c13-8d09-1c3b02ae059e req-1e96a75a-0615-4dfa-9ef9-15c4f5accb12 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086407 Aug 02 10:16:54.578404 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 61/116] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:54.592507 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:54.594506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:54.605366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.605856 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.606691 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.607443 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.626284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:54.636948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-51641efa-d3a6-46a0-a724-18e0b0f598ef tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.569209 Aug 02 10:16:54.639657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 56/117] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:54 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:54.652736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:54.654486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:54.678503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.678999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.680246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:54.680679 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:54.957009 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:54.961552 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:54.965427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-71af6000-b947-443f-90f7-7a5a84232b23 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.323781 Aug 02 10:16:54.966093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 57/118] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:54 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:54.972671 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b37962bc-25a1-4974-906f-80b6a5ffd1ab tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.392699 Aug 02 10:16:54.975894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 62/119] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:54 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:55.510571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:55.511318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:55.520035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:55.520035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:55.520035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:55.520035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:55.660561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:55.661281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:55.663142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:55.667580 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:55.668038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:55.668812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:55.669920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:55.671699 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:55.673230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:55.674414 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-56d6259c-3773-45ed-9129-d50df5d72007 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.167733 Aug 02 10:16:55.674977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 58/120] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:55 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:55.813220 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:55.820982 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-90b1f548-e94a-4bf3-b668-1c8356816170 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.164796 Aug 02 10:16:55.821659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 63/121] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:55 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:55.997382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:55.998170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:56.001190 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:56.001919 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:56.005192 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.005587 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.006394 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.006852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.008389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.008964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.010072 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.010589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.228743 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:56.242187 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:56.245250 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-230d242f-250e-4694-a4c0-b773d8821524 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.252004 Aug 02 10:16:56.246102 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 59/122] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:55 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:56.251608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d2601209-52c9-4133-a20d-4f8a78034192 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.254966 Aug 02 10:16:56.252170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 64/123] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:55 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:56.627542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-e885e733-3b5c-4604-be68-33b7ac3a150a req-47a62848-6a95-48cc-b3f6-d429e760f4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df5b287-bdb5-44e4-bbca-22bf77e34aad", "tag": "382c2947-ee5b-42e3-a51b-67d45f507974"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:16:56.644942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-e885e733-3b5c-4604-be68-33b7ac3a150a req-47a62848-6a95-48cc-b3f6-d429e760f4c0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.644942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-e885e733-3b5c-4604-be68-33b7ac3a150a req-47a62848-6a95-48cc-b3f6-d429e760f4c0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.662588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-e885e733-3b5c-4604-be68-33b7ac3a150a req-47a62848-6a95-48cc-b3f6-d429e760f4c0 service nova] Creating event network-changed:382c2947-ee5b-42e3-a51b-67d45f507974 for instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad on hv-cinder-84713 Aug 02 10:16:56.667697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-e885e733-3b5c-4604-be68-33b7ac3a150a req-47a62848-6a95-48cc-b3f6-d429e760f4c0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043783 Aug 02 10:16:56.668944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 60/124] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:16:56.698136 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:56.698995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:56.701604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:56.708155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.709009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.709818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.710646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.842904 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:56.843658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:56.850328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.851052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.852088 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:56.852942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:56.886355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:56.897163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:56.898719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:56.900027 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1f882353-811c-4311-ad98-a0243c35cac5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.205842 Aug 02 10:16:56.901039 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 65/125] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:56 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:16:57.008017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:57.018442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5e454654-a951-4cdd-bfa9-35eef8f85d65 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.179979 Aug 02 10:16:57.019179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 61/126] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:56 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:57.267122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:57.267736 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:57.272864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:57.273596 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:57.273839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:57.274076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:57.275089 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:57.275516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:57.282851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:57.283401 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:57.284253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:57.284920 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:57.497745 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:57.498099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:57.498709 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5bb311ed-f840-48ef-b16f-aeb85fb655c9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.235318 Aug 02 10:16:57.503228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-217524ef-9cf0-43b2-926f-2de6b4bf943d tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.234094 Aug 02 10:16:57.503824 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 62/127] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:57 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:57.507981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 66/128] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:57 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:57.922291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:57.922836 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:57.929313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:57.929981 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:57.930931 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:57.931518 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.039520 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:58.040118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:58.061334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:58.061809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.062582 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:58.063011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.104476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:58.130002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:58.131633 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:58.132826 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9522a21b-4665-42be-9275-23c8989cc4ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.214408 Aug 02 10:16:58.133397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 63/129] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:57 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:16:58.237055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:58.246101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4970ea63-7e50-44bc-b401-3c0c127458fc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.210273 Aug 02 10:16:58.247628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 67/130] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:58 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:58.519726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:58.520439 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:58.524042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:58.524788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:58.527141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:58.527700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.528583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:58.529090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.531320 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:58.531759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.532677 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:58.533106 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:58.537224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:58.734503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:58.736819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:58.743600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2157fba4-bb14-46f7-8bca-9eb4d5f9006d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.227534 Aug 02 10:16:58.745825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-435ff62b-cc91-4eda-994c-7526cab9161b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.224356 Aug 02 10:16:58.745981 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 64/131] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:58 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:16:58.746070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 68/132] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:58 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:59.157724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:59.158457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:59.161384 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:59.167238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.167860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.168792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.169302 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.267885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:59.268501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:59.274670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.275123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.276075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.276668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.309205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:59.316042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:59.321303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:59.323236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:59.324371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bb7b2985-72ce-446d-ba67-02ebdd136da0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.171170 Aug 02 10:16:59.325100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 65/133] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:16:59 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:16:59.414236 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:16:59.422395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e93918a3-36b8-469d-8bb9-17e95f740d05 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.158286 Aug 02 10:16:59.422962 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 69/134] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:59 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:16:59.770155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:59.771157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:59.772687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:16:59.773444 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:16:59.783301 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.784248 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.785254 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.786144 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.787517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.789083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:16:59.790681 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:16:59.795278 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:00.010642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:00.021246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8f2adc8b-70e0-44c0-ba23-fa5f570c95c0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.256386 Aug 02 10:17:00.022499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 70/135] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:59 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:00.025427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:00.035555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-87682964-3200-4570-b63c-eacedd949264 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.269460 Aug 02 10:17:00.036130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 66/136] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:16:59 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:00.348560 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:00.349269 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:00.357569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:00.358120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:00.358988 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:00.359565 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:00.448046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:00.449200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:00.458138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:00.458596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:00.459384 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:00.460042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:01.456156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:01.466906 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-43eb8547-c345-4fc1-a294-04d29947b775 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 1.026233 Aug 02 10:17:01.467495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 67/137] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:00 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:01.483892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:01.484998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:01.494337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:01.495050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:01.496258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:01.496708 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:01.665499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:01.681226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:01.683570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:01.686015 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-71fb9392-01f9-400c-934f-38d281345d0e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 1.341104 Aug 02 10:17:01.686754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 71/138] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:00 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:01.693680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:01.694647 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:01.702770 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:01.703385 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:01.704434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:01.705070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:02.237389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:02.253560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-862d295f-7495-4b00-bc72-77e9bd014a56 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.773124 Aug 02 10:17:02.254251 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 68/139] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:01 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:02.306497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:02.315581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d59dd0af-8e84-46c9-9615-34216a1270fa tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.626429 Aug 02 10:17:02.327328 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 72/140] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:01 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:02.498693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:02.501123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:02.513327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:02.514035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:02.514995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:02.515892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:02.688052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:02.696185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9e78ed2d-821d-452c-83ee-2fcdc960c303 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.208995 Aug 02 10:17:02.696795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 69/141] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:02 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:02.710138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:02.710841 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:02.718675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:02.719759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:02.720805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:02.721579 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:02.876957 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:02.885497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:02.887958 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:02.889214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6533e001-4886-4faf-b675-5839e71aee84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.183416 Aug 02 10:17:02.889753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 73/142] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:02 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:03.136572 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-f898bfff-ef63-4344-9475-3210bbdc3b8a req-c2bb4793-91fb-4a48-a2d2-eddf2fae0d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84567e7b-e992-45ea-a416-0973e4eb6ae1", "name": "network-vif-plugged", "status": "completed", "tag": "0bc292ca-839f-4a65-83be-8d5068df550e"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:03.146751 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f898bfff-ef63-4344-9475-3210bbdc3b8a req-c2bb4793-91fb-4a48-a2d2-eddf2fae0d50 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.147199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f898bfff-ef63-4344-9475-3210bbdc3b8a req-c2bb4793-91fb-4a48-a2d2-eddf2fae0d50 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.159504 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-f898bfff-ef63-4344-9475-3210bbdc3b8a req-c2bb4793-91fb-4a48-a2d2-eddf2fae0d50 service nova] Creating event network-vif-plugged:0bc292ca-839f-4a65-83be-8d5068df550e for instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 on hv-cinder-84713 Aug 02 10:17:03.164767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-f898bfff-ef63-4344-9475-3210bbdc3b8a req-c2bb4793-91fb-4a48-a2d2-eddf2fae0d50 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146387 Aug 02 10:17:03.165507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 70/143] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:17:03.280231 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:03.282573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:03.289593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.289593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.290844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.291273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.339492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:03.340443 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:03.348637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.349513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.350489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.351073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.767014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:03.781756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3a3e95da-dbb3-4175-9efc-9aa61ec73b9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.506589 Aug 02 10:17:03.783516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 74/144] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:03 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:03.793144 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:03.794654 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:03.804195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.805165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.807459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.808650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.814245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:03.826011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e23d19a8-882a-4c0c-a20e-55b334a5acb6 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.490124 Aug 02 10:17:03.827491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 71/145] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:03 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:17:03.914383 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:03.915177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:03.921837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.922560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.923333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:03.923926 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:03.981520 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:03.989715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c08f1069-fa54-4215-b342-d340c0dad276 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.204534 Aug 02 10:17:03.990488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 75/146] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:03 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:04.129549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:04.138538 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:04.140146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:04.141343 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-46fdf46e-2bae-4e80-8bf3-99972b5fbef4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.231155 Aug 02 10:17:04.142106 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 72/147] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:03 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:04.809466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:04.811548 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:04.821003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:04.822241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:04.823433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:04.824127 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:04.856170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:04.857039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:04.864425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:04.865064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:04.866178 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:04.866763 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:05.067245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:05.075471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bc7278cf-fecb-4971-9f81-1b0ca7d44997 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.274199 Aug 02 10:17:05.080324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 76/148] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:04 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:05.083996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:05.085431 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:05.086168 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:05.094896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f3415301-a3b4-4f6f-af0f-bf6852c6933e tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.245935 Aug 02 10:17:05.095380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:05.095928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:05.096787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:05.097315 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:05.101615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 73/149] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:04 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:05.166886 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:05.167522 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:05.173873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=97 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:05.175446 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:05.175905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:05.176746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:05.177180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:05.304683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:05.315157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-68a3097f-cab7-49ff-b566-f900c4eaafd8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.233526 Aug 02 10:17:05.316167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 77/150] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:05 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:05.356342 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:05.365013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:05.366636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:05.367944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-eabbc7ea-6254-495c-ae54-e6ec2416722e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.205055 Aug 02 10:17:05.368685 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 74/151] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:05 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:06.096296 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:06.097016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:06.103271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.103960 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.104906 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.105346 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.116601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:06.117850 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:06.125037 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.125571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.126588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.127211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.320471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:06.329140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9fbbc24f-be4e-4a53-ab1e-7a2ad4ab3c04 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.236628 Aug 02 10:17:06.344729 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:06.344729 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e8a617fd-f74e-4530-a965-91b184252003 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.232037 Aug 02 10:17:06.345559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 75/153] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:06 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:17:06.345765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 78/153] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:06 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:06.351030 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:06.351583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:06.358016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.358670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.359423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.359963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.396353 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:06.396972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:06.404426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.405005 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.405881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:06.406567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:06.559460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:06.572890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a5518659-1d16-4e4c-ac4b-2371c45050d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.225653 Aug 02 10:17:06.574531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 79/154] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:06 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:06.606161 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:06.616479 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:06.618194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:06.619330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-05597324-f6d5-4695-b4a8-5b079ade134b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.229956 Aug 02 10:17:06.619887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 76/155] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:06 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:07.357472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:07.358142 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:07.366250 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:07.366806 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.366902 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:07.367238 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.368093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.368501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.374492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.375036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.376076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.376585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.576021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:07.583666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:07.584695 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f2dfc386-7fab-4c3f-ac93-a6dba4c55fe5 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.222358 Aug 02 10:17:07.585353 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 77/156] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:07 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:07.592168 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7e400f27-1e8c-48a8-9267-5f7f9b02a513 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.238415 Aug 02 10:17:07.592971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 80/157] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:07 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:07.598768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:07.600019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:07.612785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.614157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.616310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.617571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.643681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:07.644427 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:07.650808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.651967 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.653456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:07.654023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:07.833486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:07.846352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:07.855758 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:07.857288 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:07.858974 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-dd4e1a14-d353-4f50-bb11-be4ce517c1f1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.266947 Aug 02 10:17:07.859645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 78/158] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:07 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:07.860772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ff815e59-387c-4fea-91d4-4bbde22c2517 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.221401 Aug 02 10:17:07.861304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 81/159] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:07 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:08.604533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:08.605145 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:08.612484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:08.612985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:08.613323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:08.613941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:08.614076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:08.614480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:08.620403 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:08.621094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:08.621894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:08.622336 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:08.893476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:08.901388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c0f6480c-f50d-4a9b-be89-97beefdb874c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.300241 Aug 02 10:17:08.903311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 79/160] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:08 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:08.911676 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:08.912448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:08.923626 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:08.924085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:08.924868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:08.925367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:09.006649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:09.022458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-704969ee-e057-42d3-a7e8-272afb85f9de tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.413291 Aug 02 10:17:09.024196 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 82/161] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:08 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:09.034403 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:09.035830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:09.048752 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:09.049545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:09.051042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:09.051803 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:09.230726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:09.242305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6515de98-d08f-4aa7-8d8d-4e738f9d0630 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.334777 Aug 02 10:17:09.256944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 80/162] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:08 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:09.277635 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:09.286433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:09.287973 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:09.289104 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-50845a44-950a-4c05-9bf8-6869f74b3bcd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.263362 Aug 02 10:17:09.289857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 83/163] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:09 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:09.928143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:09.929333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:09.943543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:09.944544 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:09.945489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:09.946598 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.071027 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:10.071960 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:10.083581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:10.084038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.084831 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:10.085272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.146860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:10.157118 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-224e2c91-f676-427a-aca9-585e3a0efe89 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.233394 Aug 02 10:17:10.175350 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 81/164] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:09 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:10.264976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:10.265592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:10.285248 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:10.285697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.286508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:10.286910 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.339961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:10.343739 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:10.349425 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6f0f4b34-d276-4c7f-a0e7-3a8bf14bbc2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.284823 Aug 02 10:17:10.350455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 84/165] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:10 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:10.357072 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:10.357692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:10.364978 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:10.365610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.366570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:10.367215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:10.664504 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:10.674503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d078a6d4-d821-42db-a0a2-d40c8ad7b444 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.414806 Aug 02 10:17:10.679749 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 82/166] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:10 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:10.714477 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:10.724561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:10.727728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:10.729512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-86ab0eb0-62d4-412f-aaf0-c381bf762338 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.377787 Aug 02 10:17:10.730588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 85/167] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:10 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:11.179174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:11.180767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:11.190961 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:11.191883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:11.197647 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:11.198882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:11.204653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:11.374033 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:11.374655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:11.381326 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:11.382797 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:11.384086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:11.384749 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:12.080020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:12.089594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-62a09e0e-8013-46d1-bbb0-51de1e3d63cc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.914977 Aug 02 10:17:12.103146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 83/168] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:11 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:12.109235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:12.110069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:12.121756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:12.122749 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:12.123931 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:12.124500 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:12.262316 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:12.278694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3d9b1490-ccb3-44f7-aed5-4b5b26d28d57 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.908633 Aug 02 10:17:12.279278 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 86/169] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:11 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:12.284130 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:12.284735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:12.286601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=91 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:12.306016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:12.307448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:12.307751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:12.308184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:12.557201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:12.569328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-841d07c1-c452-444f-be7f-645779ce7253 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.464707 Aug 02 10:17:12.572221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 84/170] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:12 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:12.597913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:12.608923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:12.611531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:12.612982 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fc46a274-d8fe-4dc5-a952-68ba2c12d6ae tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.332767 Aug 02 10:17:12.613586 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 87/171] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:12 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:12.888472 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-61eccf91-e5b7-44f4-baf5-2171a654c35e req-21f45859-8ac6-4479-b172-87740597f8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df5b287-bdb5-44e4-bbca-22bf77e34aad", "name": "network-vif-plugged", "status": "completed", "tag": "382c2947-ee5b-42e3-a51b-67d45f507974"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:12.899678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-61eccf91-e5b7-44f4-baf5-2171a654c35e req-21f45859-8ac6-4479-b172-87740597f8dd service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:12.900115 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-61eccf91-e5b7-44f4-baf5-2171a654c35e req-21f45859-8ac6-4479-b172-87740597f8dd service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:12.913151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-61eccf91-e5b7-44f4-baf5-2171a654c35e req-21f45859-8ac6-4479-b172-87740597f8dd service nova] Creating event network-vif-plugged:382c2947-ee5b-42e3-a51b-67d45f507974 for instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad on hv-cinder-84713 Aug 02 10:17:12.923985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-61eccf91-e5b7-44f4-baf5-2171a654c35e req-21f45859-8ac6-4479-b172-87740597f8dd service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039430 Aug 02 10:17:12.925805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 85/172] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:17:13.123484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:13.124101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:13.130792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.131420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.132213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.132642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.281546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:13.289153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fbecadb6-8b48-4adc-a6e8-bf05ebfc73d0 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.170068 Aug 02 10:17:13.290145 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 88/173] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:13 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:17:13.304539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:13.305445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:13.312733 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.313192 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.314421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.314857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.500826 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:13.509933 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b0572c8e-1708-47ec-9c95-8939d98f944f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.210112 Aug 02 10:17:13.511758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 86/174] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:13 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:13.591590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:13.592210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:13.603661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.604363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.605102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.605546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.639703 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:13.640319 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:13.650643 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.651099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.654993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:13.655451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:13.833042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:13.853615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-440a39a8-008a-4e05-a761-d0d0e7bf399d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.265787 Aug 02 10:17:13.855007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 89/175] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:13 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:13.900100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:13.908882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:13.910352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:13.911485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0ee55fce-78c8-48b1-ba0d-3018cf8c1867 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.277408 Aug 02 10:17:13.926982 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 87/176] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:13 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:14.311487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:14.312391 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:14.323442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.323981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.324667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.325104 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.533897 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:14.534732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:14.541198 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.541924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.542887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.543497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.700431 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:14.714968 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6cb96421-4f9e-4a74-a50a-9bd1ffb1b075 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.407778 Aug 02 10:17:14.715824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 90/177] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:14 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:14.876566 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:14.877178 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:14.894260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.894707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.895754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.896347 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.911878 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:14.922485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8f4d0f48-9721-4452-840a-51a985019d62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.393960 Aug 02 10:17:14.939086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 88/178] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:14 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:14.951194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:14.952613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:14.961590 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.962368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:14.964048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:14.965203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:15.157556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:15.171403 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-445c93e8-98e2-4045-914c-307e45f0723d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.298904 Aug 02 10:17:15.186192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 91/179] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:14 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:17:15.186192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-e37611d7-c9a0-4285-b64b-99f81b3aeffd req-fd9f07de-9e2a-4cd9-9061-59f10be4375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "name": "network-vif-plugged", "status": "completed", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:15.208663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-e37611d7-c9a0-4285-b64b-99f81b3aeffd req-fd9f07de-9e2a-4cd9-9061-59f10be4375e service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:15.209113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-e37611d7-c9a0-4285-b64b-99f81b3aeffd req-fd9f07de-9e2a-4cd9-9061-59f10be4375e service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:15.209607 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:15.223042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:15.223229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-e37611d7-c9a0-4285-b64b-99f81b3aeffd req-fd9f07de-9e2a-4cd9-9061-59f10be4375e service nova] Creating event network-vif-plugged:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:17:15.226044 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:15.228421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-e37611d7-c9a0-4285-b64b-99f81b3aeffd req-fd9f07de-9e2a-4cd9-9061-59f10be4375e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054337 Aug 02 10:17:15.228567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d36e4e1c-a8d5-4137-90ee-e874eb238f86 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.287541 Aug 02 10:17:15.228987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 92/180] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:17:15.233533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 89/181] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:14 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:15.739255 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:15.740201 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:15.748137 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:15.748801 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:15.749892 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:15.750328 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:15.945901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:15.947336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:15.953094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:15.965766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a7340f03-223d-4322-ab65-062c8a536b79 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.232079 Aug 02 10:17:15.966581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 93/182] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:15 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:15.968121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:15.968977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:15.969952 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:15.970526 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:16.192601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:16.193528 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:16.201935 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:16.202655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:16.203628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:16.204058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:16.232034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:16.251214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ed4e4964-5957-47ca-adf6-521fba3bb66d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.308673 Aug 02 10:17:16.252497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 90/183] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:15 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:16.269957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:16.271605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:16.279988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:16.281360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:16.284078 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:16.285006 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:16.577193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:16.586894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c3ca5dc7-5dee-47f6-b6cf-62dba6e0b632 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.398068 Aug 02 10:17:16.587472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 94/184] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:16 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:16.668746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:16.680664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:16.682963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:16.684585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f2df794d-acbf-4248-827b-c59f6b391b5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.428289 Aug 02 10:17:16.685879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 91/185] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:16 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:16.988564 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:16.989206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:16.996713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:16.998716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.000534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.001580 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.279669 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:17.280332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:17.287213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.291957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.292768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.293205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.337750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:17.348141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-09e2ee7d-d771-407a-b181-6244dcac854c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.363476 Aug 02 10:17:17.352306 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 95/186] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:16 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:17.618449 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:17.622035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:17.645948 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.649397 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.654362 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.657159 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.672284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:17.681448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ab2c466a-8741-4056-aa85-72666893629f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.406379 Aug 02 10:17:17.685837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 92/187] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:17 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:17.710331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:17.711421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:17.720603 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.722640 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:17.725335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:17.727252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:18.059362 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:18.076832 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a7fd1896-687f-4dad-b94d-528628823112 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.464642 Aug 02 10:17:18.079787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 96/188] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:17 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:17:18.095570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:18.106503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:18.109687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:18.111362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b0314fc1-8960-4fae-ab2c-7edeeca6452d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.404832 Aug 02 10:17:18.128126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 93/189] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:17 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:18.376618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:18.377232 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:18.385538 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:18.386004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:18.397308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:18.398124 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:18.601597 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:18.611399 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bff6ad59-10ea-43ad-85ae-f7554609f195 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.238602 Aug 02 10:17:18.612177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 97/190] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:18 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:18.707720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:18.708951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:18.724038 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:18.724509 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:18.725299 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:18.725741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:18.984661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:18.998978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a1e6572f-df4f-48ed-b721-88d1f219e206 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.294431 Aug 02 10:17:18.999975 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 94/191] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:18 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:19.115387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:19.116619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:19.127928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:19.128555 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:19.133071 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:19.134463 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:19.138058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:19.139206 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:19.163937 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:19.164831 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:19.171785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:19.174361 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:19.588962 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:19.602393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-434257fb-20b2-4bef-b57c-fd37801ab9b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.490971 Aug 02 10:17:19.631839 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 98/192] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:19 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:19.647732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:19.648685 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:19.662344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:19.666321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:19.667380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:19.676074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:19.709381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:19.726140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:19.731638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:19.733655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-21f09473-7cc7-43cc-8500-8edd4dc1bf58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.600471 Aug 02 10:17:19.739705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 95/193] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:19 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:20.020054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:20.022110 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:20.030100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:20.030559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:20.031344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:20.031839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:20.206065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:20.242643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-666ca92d-f571-482b-95cc-250d3817275b tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.603899 Aug 02 10:17:20.245424 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 99/194] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:19 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:20.482335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:20.494312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-980c04a7-9801-4b95-b284-609e688bbfb1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.478042 Aug 02 10:17:20.498841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 96/195] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:20 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:20.628421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:20.630411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:20.645979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:20.649038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:20.651157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:20.652639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:20.766615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:20.767428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:20.777066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:20.777737 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:20.780483 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:20.781050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:21.377149 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:21.383491 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:21.389102 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:21.390772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:21.392186 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0434ef25-101f-4bb3-a515-1ac8b3d0067e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.629806 Aug 02 10:17:21.392757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 97/196] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:20 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:21.398246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:21.399023 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:21.406201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:21.407301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:21.408282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:21.408868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4bd27371-adc7-4b2c-993e-efc7caddd5d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.785005 Aug 02 10:17:21.409029 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:21.409459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 100/197] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:20 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:21.521143 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:21.521662 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:21.531924 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:21.532378 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:21.535692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:21.536869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:21.756406 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:21.783706 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ed0026da-b039-40cb-ae07-46f8551b3b55 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1314 microversion: 2.1 time: 0.389333 Aug 02 10:17:21.788474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 98/198] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:21 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:21.809298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:21.824074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8a3cde3b-1fd4-4f9f-b788-821c967af025 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.307268 Aug 02 10:17:21.826706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 101/199] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:21 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:22.279807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-0e5d6ad0-4f4a-4d24-886f-6f0c2b1a493f req-7fd6bbcc-87a4-454a-90ba-0c5d507004c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df694e6a-8f96-4024-9f32-7fd36d7114fe", "name": "network-vif-plugged", "status": "completed", "tag": "cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:22.303707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-0e5d6ad0-4f4a-4d24-886f-6f0c2b1a493f req-7fd6bbcc-87a4-454a-90ba-0c5d507004c3 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:22.304467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-0e5d6ad0-4f4a-4d24-886f-6f0c2b1a493f req-7fd6bbcc-87a4-454a-90ba-0c5d507004c3 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:22.331239 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-0e5d6ad0-4f4a-4d24-886f-6f0c2b1a493f req-7fd6bbcc-87a4-454a-90ba-0c5d507004c3 service nova] Creating event network-vif-plugged:cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6 for instance df694e6a-8f96-4024-9f32-7fd36d7114fe on hv-cinder-84713 Aug 02 10:17:22.351089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-0e5d6ad0-4f4a-4d24-886f-6f0c2b1a493f req-7fd6bbcc-87a4-454a-90ba-0c5d507004c3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075456 Aug 02 10:17:22.351872 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 99/200] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:17:22.420794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:22.422388 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:22.432301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:22.433277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:22.444138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:22.448943 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:22.452470 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:22.454351 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:22.455209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:22.457009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:22.458085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:22.465194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:22.546688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:23.039841 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:23.051472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:23.059491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:23.064719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:23.069972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b55a5fd4-c8c3-4d7d-827d-aa192b148739 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.642757 Aug 02 10:17:23.071434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-40eb89a9-923b-4185-9d87-9e104e0e4dd8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.655960 Aug 02 10:17:23.072011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 102/201] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:22 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:23.072790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 100/202] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:22 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:23.079754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:23.080376 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:23.098478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:23.099498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:23.108802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:23.110220 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:23.110381 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:23.111487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:23.111776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:23.112354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:23.112849 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:23.113381 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:23.117976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:23.532589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:23.542100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:23.548850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-22aa1972-1242-4efe-96b4-97dbeea3d5dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1501 microversion: 2.1 time: 0.474024 Aug 02 10:17:23.549436 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 103/203] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:23 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:23.550798 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-613daf5a-519a-4b75-a887-6533d4815996 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.476970 Aug 02 10:17:23.554595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 101/204] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:23 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:24.095790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:24.096999 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:24.109225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:24.110757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:24.118250 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:24.120688 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:24.122061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:24.122734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:24.125381 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:24.126114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:24.130514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:24.131431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:24.822025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:24.838741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:24.840287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:24.841554 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d4451eee-b118-408c-93fa-fc6426beed91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.736667 Aug 02 10:17:24.847299 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 102/205] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:24 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:24.855650 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:24.858508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:24.868565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:24.869745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:24.870582 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:24.871334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:24.975672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:24.992203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-13060a23-7250-4dde-8bc3-9dcb95da4a14 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.902502 Aug 02 10:17:24.993150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 104/206] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:24 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:25.410517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:25.423913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e7288074-0130-4736-9916-d2286722448f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.575264 Aug 02 10:17:25.431495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 103/207] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:24 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:25.457116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a38674b-efc1-45e6-ad58-db57d760b47b"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:25.461368 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:25.483634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:25.488023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:25.490046 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:25.492122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:25.870235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:25.871150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:25.883060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:25.883987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:25.884924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:25.885510 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:26.064906 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:26.074083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:26.077574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:26.079785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-620a632f-84b6-463e-ae35-804191851626 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1408 microversion: 2.20 time: 0.213995 Aug 02 10:17:26.080901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 104/208] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:25 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:17:26.085981 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:26.086822 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:26.093545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:26.095256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:26.097731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:26.098682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:26.294691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:26.305962 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-740a323f-3fa6-4e17-bf1e-a91553463072 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.223536 Aug 02 10:17:26.306708 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 105/209] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:26 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:26.453894 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:26.455888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:26.465346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:26.466032 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:26.468114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:26.469960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:26.650283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:26.666281 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e032e48f-f052-4e3e-9165-011c82961724 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.217981 Aug 02 10:17:26.667796 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 106/210] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:26 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:26.721072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-ab06d6bb-0e05-4d0d-9fe3-ebf58dcbd221 req-b1514b36-842f-4807-8c38-d44edb08fa75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5864b784-67b0-4103-b4ca-1fa50804e269", "name": "network-vif-plugged", "status": "completed", "tag": "2e6932a7-2bdf-48ce-9599-52404dd3c01d"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:26.738617 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ab06d6bb-0e05-4d0d-9fe3-ebf58dcbd221 req-b1514b36-842f-4807-8c38-d44edb08fa75 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:26.739482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ab06d6bb-0e05-4d0d-9fe3-ebf58dcbd221 req-b1514b36-842f-4807-8c38-d44edb08fa75 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:26.757719 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-ab06d6bb-0e05-4d0d-9fe3-ebf58dcbd221 req-b1514b36-842f-4807-8c38-d44edb08fa75 service nova] Creating event network-vif-plugged:2e6932a7-2bdf-48ce-9599-52404dd3c01d for instance 5864b784-67b0-4103-b4ca-1fa50804e269 on hv-cinder-84713 Aug 02 10:17:26.766130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-ab06d6bb-0e05-4d0d-9fe3-ebf58dcbd221 req-b1514b36-842f-4807-8c38-d44edb08fa75 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048427 Aug 02 10:17:26.767475 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 107/211] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:17:27.108503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:27.109139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:27.120066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:27.121388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:27.124225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:27.124668 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:27.499442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:27.511910 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:27.517184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:27.518477 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a3eb9891-db56-4664-8deb-18cb62fcfad9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1601 microversion: 2.20 time: 0.415076 Aug 02 10:17:27.519031 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 108/212] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:17:27 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1601 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:17:27.558761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:27.561283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:27.579000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:27.579429 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:27.583841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:27.584286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:27.934024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:27.955182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b78c3318-20b0-4d57-a4e7-437c83160fe2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1361 microversion: 2.1 time: 0.415513 Aug 02 10:17:27.955979 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 109/213] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:27 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:27.970838 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:27.972548 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:28.004366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:28.005033 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:28.006181 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:28.006628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:28.328368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0aa0c0aa-9450-4720-af6e-2835ad2b619d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.371196 Aug 02 10:17:28.329266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 110/214] 10.222.0.82 () {60 vars in 1316 bytes} [Tue Aug 2 10:17:27 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-interface => generated 285 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:17:28.336752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:28.336752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:28.349867 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:28.350296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:28.365307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:28.365776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:28.772486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:28.792991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-86a446bb-745c-4988-8374-e82236452516 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.462411 Aug 02 10:17:28.806583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 111/215] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:28 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:28.942866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2e611493-a4fb-472d-88b2-dbce34c674fc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "POST /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.487424 Aug 02 10:17:28.943576 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 105/216] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:17:25 2022] POST /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1/os-volume_attachments => generated 194 bytes in 3494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:17:28.983322 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:28.984121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:29.000060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:29.000519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:29.003362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:29.003811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:29.388882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:29.402959 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5edefd44-977e-4104-8302-a31696a9a8b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1546 microversion: 2.1 time: 0.428263 Aug 02 10:17:29.431439 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:29.432345 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:29.436604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 112/217] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:28 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1546 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:29.476598 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:29.477292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:29.483682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:29.484990 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:29.734214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c75e5bfd-9094-4b5b-821b-55698be1f57e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.308424 Aug 02 10:17:29.738694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 106/218] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:17:29 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-interface => generated 284 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:17:29.829056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:29.830409 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:29.838807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:29.839519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:29.840581 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:29.841721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:30.483317 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:30.503136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-635b75ee-0d4e-42a0-aaa4-ae11dc8ab7b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1322 microversion: 2.1 time: 0.679001 Aug 02 10:17:30.504464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 113/219] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:29 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1322 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:31.528296 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:31.529469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:31.535913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-916a408c-c670-4305-b182-69b509bab0bf req-596b4609-44b4-4a57-b7ea-07d3d6d9b3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:31.551859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:31.554393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:31.557741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:31.563179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-916a408c-c670-4305-b182-69b509bab0bf req-596b4609-44b4-4a57-b7ea-07d3d6d9b3a0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:31.563467 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:31.564060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-916a408c-c670-4305-b182-69b509bab0bf req-596b4609-44b4-4a57-b7ea-07d3d6d9b3a0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:31.578306 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-916a408c-c670-4305-b182-69b509bab0bf req-596b4609-44b4-4a57-b7ea-07d3d6d9b3a0 service nova] Creating event network-changed:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:17:31.590395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-916a408c-c670-4305-b182-69b509bab0bf req-596b4609-44b4-4a57-b7ea-07d3d6d9b3a0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058656 Aug 02 10:17:31.591390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 114/220] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:17:32.731241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:32.754158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e1938252-53e5-4ae4-970b-30500af340ee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1516 microversion: 2.1 time: 1.231264 Aug 02 10:17:32.757985 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 107/221] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:31 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1516 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:32.791875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:32.799352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:32.816305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:32.817008 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:32.817989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:32.822203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:32.890086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lazy-loading 'flavor' on Instance uuid 5864b784-67b0-4103-b4ca-1fa50804e269 {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:17:33.183173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1c1dfeb4-447c-484f-9f9e-6e4fc3abc041 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269/action" status: 200 len: 32 microversion: 2.1 time: 0.394175 Aug 02 10:17:33.189429 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 115/222] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:17:32 2022] POST /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:17:33.199896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:33.200518 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:33.221388 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:33.221893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:33.222984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:33.224816 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:33.997556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:34.016995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-71253a81-4d10-4f8e-9475-8c101e558e93 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.824141 Aug 02 10:17:34.018641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 108/223] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:33 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:35.044969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:35.045694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:35.053267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:35.054424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:35.055449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:35.056050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:35.459458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-dee89246-6364-4fa3-981e-9bf77257fc37 req-ee865cb9-8a57-4261-b65f-e2940bd55da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df694e6a-8f96-4024-9f32-7fd36d7114fe", "tag": "cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:35.477054 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-dee89246-6364-4fa3-981e-9bf77257fc37 req-ee865cb9-8a57-4261-b65f-e2940bd55da1 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:35.477649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-dee89246-6364-4fa3-981e-9bf77257fc37 req-ee865cb9-8a57-4261-b65f-e2940bd55da1 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:35.498270 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-dee89246-6364-4fa3-981e-9bf77257fc37 req-ee865cb9-8a57-4261-b65f-e2940bd55da1 service nova] Creating event network-changed:cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6 for instance df694e6a-8f96-4024-9f32-7fd36d7114fe on hv-cinder-84713 Aug 02 10:17:35.507125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-dee89246-6364-4fa3-981e-9bf77257fc37 req-ee865cb9-8a57-4261-b65f-e2940bd55da1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056210 Aug 02 10:17:35.509184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 109/224] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:17:35.599921 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:35.614488 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e2dcf745-c5dc-4b38-9b50-a25a4ebea7db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.574088 Aug 02 10:17:35.616497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 116/225] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:35 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:36.637881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:36.638895 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:36.650777 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:36.650777 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:36.654893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:36.655568 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:36.964307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:36.974232 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-629dd742-2b59-494d-929b-071bdaf8220a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.341446 Aug 02 10:17:36.974818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 110/226] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:36 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:37.996805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:37.997484 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:38.000720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=86 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:38.008220 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:38.009080 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:38.010147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:38.010789 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:38.037489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:38.280168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:38.291603 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-88d24379-6167-46d1-bbfe-5fff26cbc57b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.299402 Aug 02 10:17:38.307707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 117/227] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:37 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:39.224839 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:39.226468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:39.239793 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:39.240705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:39.245821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:39.246732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:39.295905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:17:39.313802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:39.314557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:39.326969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:39.328112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:39.331860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:39.333120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:39.548064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0672b1d3-3ddf-4804-b03a-6a3508729f0c tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "DELETE /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 204 len: 0 microversion: 2.1 time: 0.333902 Aug 02 10:17:39.549180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 111/228] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:17:39 2022] DELETE /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:17:39.565740 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:39.567851 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:39.580592 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:39.583354 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:39.584927 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:39.585424 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:39.882917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:39.906155 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a9f3d552-cf86-4e22-bd47-62d1a122d792 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.595195 Aug 02 10:17:39.909538 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 118/229] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:39 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:39.981717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:39.996795 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6a1e1897-7702-4ff7-a177-9053b0990852 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1553 microversion: 2.1 time: 0.441985 Aug 02 10:17:39.998550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 112/230] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:39 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1553 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:40.946337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:40.947374 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:40.969769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:40.971009 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:40.973636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:40.974290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:41.020044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:41.020771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:41.028347 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:41.029700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:41.030763 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:41.031536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:41.516426 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:41.544194 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-486a90c3-a2cf-4807-83f6-1904c36f2f28 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1553 microversion: 2.1 time: 0.528096 Aug 02 10:17:41.545185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:41.545384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 113/231] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:41 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1553 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:17:41.554795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-95821dfb-e889-4787-97e3-eac219e9d1fc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.619518 Aug 02 10:17:41.555972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 119/232] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:40 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:42.572932 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:42.574405 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:42.584338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:42.585341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:42.586800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:42.588735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:42.591914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:42.593462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:42.595848 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:42.603641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:42.604107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:42.604899 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:42.605378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:43.345193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:43.350430 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:43.359078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-96bc55b9-a333-4509-bf68-cd4a239b7dc3 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1553 microversion: 2.1 time: 0.790349 Aug 02 10:17:43.375844 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4d2e5909-1ebc-4df1-8c61-c52433f82ab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.785833 Aug 02 10:17:43.381417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 120/233] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:42 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:43.384309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 114/234] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:42 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1553 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:43.944314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-8ebf7525-547f-439a-bcb1-733e92d4148f req-4146ac37-3980-4eaa-8d35-ad8fdfbe06f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84567e7b-e992-45ea-a416-0973e4eb6ae1", "name": "network-vif-deleted", "tag": "0bc292ca-839f-4a65-83be-8d5068df550e"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:43.957555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-8ebf7525-547f-439a-bcb1-733e92d4148f req-4146ac37-3980-4eaa-8d35-ad8fdfbe06f5 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:43.958346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-8ebf7525-547f-439a-bcb1-733e92d4148f req-4146ac37-3980-4eaa-8d35-ad8fdfbe06f5 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:43.974086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-8ebf7525-547f-439a-bcb1-733e92d4148f req-4146ac37-3980-4eaa-8d35-ad8fdfbe06f5 service nova] Creating event network-vif-deleted:0bc292ca-839f-4a65-83be-8d5068df550e for instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 on hv-cinder-84713 Aug 02 10:17:43.980092 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-8ebf7525-547f-439a-bcb1-733e92d4148f req-4146ac37-3980-4eaa-8d35-ad8fdfbe06f5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039579 Aug 02 10:17:43.986027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 121/235] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:17:44.388865 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:44.389990 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:44.390861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:44.392071 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:44.411734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:44.417467 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:44.419949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:44.420308 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:44.421849 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:44.423184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:44.425252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:44.426521 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:44.919922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f690a9da98b548e9aee69426281ae428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088b96c6fcf64d899fbbe739c682de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:44.932796 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-76638d80-d0a6-4fc1-a2c0-8894d5b640e1 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 200 len: 1345 microversion: 2.1 time: 0.549064 Aug 02 10:17:44.955636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 122/236] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:44 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 1345 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:45.004396 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:45.023292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-819f7939-b1d5-4c37-9bc2-3575650ddd8c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.633499 Aug 02 10:17:45.023930 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 115/237] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:44 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:45.983556 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:45.984886 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:45.995388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:45.995927 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:46.007225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:46.007792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:46.038342 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] HTTP exception thrown: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.048917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Request method failure captured: Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 HTTP/1.1 Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pln7a42P42gYUo_0NcZUSJTotOxIJjlHvv1iBql6ORe8u3jl-JnL4kqDLe5ls7HcEFlPYwtuOGtPc2sIYZaWtlsLpermymDw8nCbbbs-SiJCNnyLCZ_4vznwS751jHnOiMxToj_ZyUuqvLUEzFDQgO_Zrhvkcr6s1RB5HFN0xtjoIc Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:17:46.050051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_088b96c6fcf64d899fbbe739c682de7d", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: f690a9da98b548e9aee69426281ae428 Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.051819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '84567e7b-e992-45ea-a416-0973e4eb6ae1'} Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:17:46.052766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.054240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.055877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Returning 404 to user: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:17:46.057096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8071f0bd-c208-491d-84a4-35ddee010949 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 404 len: 111 microversion: 2.1 time: 0.099708 Aug 02 10:17:46.058360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:46.071956 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:46.073074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:46.074869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:46.077058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:46.077535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 123/238] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:45 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:17:46.251899 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:46.255432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:46.283053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:46.290994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:46.292176 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:46.297046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:46.318613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] HTTP exception thrown: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Request method failure captured: Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1/os-volume_attachments HTTP/1.1 Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pln7a42P42gYUo_0NcZUSJTotOxIJjlHvv1iBql6ORe8u3jl-JnL4kqDLe5ls7HcEFlPYwtuOGtPc2sIYZaWtlsLpermymDw8nCbbbs-SiJCNnyLCZ_4vznwS751jHnOiMxToj_ZyUuqvLUEzFDQgO_Zrhvkcr6s1RB5HFN0xtjoIc Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:17:46.321491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_088b96c6fcf64d899fbbe739c682de7d", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: f690a9da98b548e9aee69426281ae428 Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.322801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'server_id': '84567e7b-e992-45ea-a416-0973e4eb6ae1'} Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:17:46.323474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:46.324537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:46.329518 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Returning 404 to user: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:17:46.330656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ec540d48-8240-410e-81b9-ef6e6ae5e338 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.085123 Aug 02 10:17:46.331911 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 124/239] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:17:46 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1/os-volume_attachments => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:17:46.341364 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:46.344807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:46.350299 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ab3b4622-d979-4677-a597-f72da317859b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.304705 Aug 02 10:17:46.351112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 116/240] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:46 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:47.382435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:47.383088 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:47.401491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:47.409267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:47.410426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:47.411782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:47.723472 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:47.734425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1f1032ed-4734-4eea-bb96-706e63f28a64 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.365069 Aug 02 10:17:47.735667 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 125/241] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:47 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:47.803218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:47.803218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:47.822925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:47.822925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:47.823605 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:47.824122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:47.859094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] HTTP exception thrown: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Request method failure captured: Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: DELETE /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 HTTP/1.1 Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pln7a42P42gYUo_0NcZUSJTotOxIJjlHvv1iBql6ORe8u3jl-JnL4kqDLe5ls7HcEFlPYwtuOGtPc2sIYZaWtlsLpermymDw8nCbbbs-SiJCNnyLCZ_4vznwS751jHnOiMxToj_ZyUuqvLUEzFDQgO_Zrhvkcr6s1RB5HFN0xtjoIc Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:17:47.885837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_088b96c6fcf64d899fbbe739c682de7d", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: f690a9da98b548e9aee69426281ae428 Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.887321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '84567e7b-e992-45ea-a416-0973e4eb6ae1'} Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:17:47.888119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.890114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.892826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Returning 404 to user: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:17:47.894914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-357b0d05-1420-4e50-804c-a8b6d9357e10 tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "DELETE /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 404 len: 111 microversion: 2.1 time: 0.097789 Aug 02 10:17:47.896529 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 117/242] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:17:47 2022] DELETE /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:17:47.906644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:47.907256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] [instance: 84567e7b-e992-45ea-a416-0973e4eb6ae1] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:47.923410 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:47.924148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:47.925099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:47.925684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:47.946256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] HTTP exception thrown: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Request method failure captured: Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 HTTP/1.1 Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pln7a42P42gYUo_0NcZUSJTotOxIJjlHvv1iBql6ORe8u3jl-JnL4kqDLe5ls7HcEFlPYwtuOGtPc2sIYZaWtlsLpermymDw8nCbbbs-SiJCNnyLCZ_4vznwS751jHnOiMxToj_ZyUuqvLUEzFDQgO_Zrhvkcr6s1RB5HFN0xtjoIc Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:17:47.948901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/088b96c6fcf64d899fbbe739c682de7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_088b96c6fcf64d899fbbe739c682de7d", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 088b96c6fcf64d899fbbe739c682de7d Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-DeleteServersTestJSON-307047175 Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: f690a9da98b548e9aee69426281ae428 Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-DeleteServersTestJSON-307047175-project Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.950549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '84567e7b-e992-45ea-a416-0973e4eb6ae1'} Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:17:47.952269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. Aug 02 10:17:47.953586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:17:47.956087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] Returning 404 to user: Instance 84567e7b-e992-45ea-a416-0973e4eb6ae1 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:17:47.957170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1351a12b-ff2d-44ce-8d96-e7fd05cd34dc tempest-DeleteServersTestJSON-307047175 tempest-DeleteServersTestJSON-307047175-project] 10.222.0.82 "GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1" status: 404 len: 111 microversion: 2.1 time: 0.055750 Aug 02 10:17:47.962132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 126/243] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:47 2022] GET /compute/v2.1/servers/84567e7b-e992-45ea-a416-0973e4eb6ae1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:17:48.755794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:48.756534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:48.775262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:48.775717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:48.776506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:48.776941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:49.667316 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:49.687829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-22eb786f-1775-4c0e-b368-5d106a583810 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.936564 Aug 02 10:17:49.690825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 118/244] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:48 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:50.725296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:50.726829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:50.735155 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:50.735888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:50.739033 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:50.739677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:51.168762 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:51.182433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-07fdadb8-4166-494e-8e51-a43eb9dfadc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.465638 Aug 02 10:17:51.185090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 127/245] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:50 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:52.213537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:52.215792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:52.237135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:52.238998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:52.240400 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:52.240860 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:53.326682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:53.340908 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-316c52fd-fb1a-4b59-bc71-6828a4be67c3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 1.132103 Aug 02 10:17:53.342860 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 119/246] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:52 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:54.364525 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:54.366114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:54.378471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:54.379813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:54.384151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:54.385140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:55.195337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:55.209397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c5625a8b-b3b1-4910-a7d2-68e7004c4c41 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.845435 Aug 02 10:17:55.217049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 128/247] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:54 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:56.237053 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:56.237712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:56.262911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:56.266600 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:56.270388 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:56.270843 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:56.540795 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:56.554063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-44e3b25f-72b7-4ef8-bb7f-a93f10d4afcf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.324624 Aug 02 10:17:56.571842 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 120/248] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:56 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:57.579927 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:57.582276 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:57.592694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:57.593984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:57.595301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:57.596205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:57.830367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:57.838635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a42c93d3-cc4e-4e68-bf8c-0551f67dea3a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.265170 Aug 02 10:17:57.843944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 129/249] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:57 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:17:58.238900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-43438e02-8b13-455c-8e32-ccddcb2f3d0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Action: 'create', calling method: .version_select at 0x7f5c080fa940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1707332186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIvNyt6JnYOpvanS8v0f6OgAHuRIhrzqyUJ42blQXpVRDTX9hlA/ec0LQ9WB2oP9ZrKOXmYvnkMO63ZlGAOimXowZlrzUNVIj6zSOEOaykeKvItHUsU7m6N2aZwQMkwUw=="}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:17:58.261931 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-43438e02-8b13-455c-8e32-ccddcb2f3d0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Getting quotas for project 99a92325ab3d4ec2bbecffb9a6e609d5. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:17:58.267824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-43438e02-8b13-455c-8e32-ccddcb2f3d0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Getting quotas for user 7b672b80961445c3a3a9b2d784f64208 and project 99a92325ab3d4ec2bbecffb9a6e609d5. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:17:58.300978 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-43438e02-8b13-455c-8e32-ccddcb2f3d0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.536537 Aug 02 10:17:58.307333 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 121/250] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:17:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:17:58.895735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:17:58.897226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:17:58.909038 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:58.910008 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:58.911399 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:17:58.914004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:17:59.416215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:17:59.448786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8c028fd9-cc02-44a1-99f1-12b808906cf4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.556913 Aug 02 10:17:59.449851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 130/251] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:17:58 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:00.471013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:00.471665 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:00.481723 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:00.482666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:00.483676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:00.484533 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:00.746006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:00.758917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cda69579-df65-42aa-bf7e-c80dd868568d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.290192 Aug 02 10:18:00.760433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 122/252] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:00 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:01.783325 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:01.783950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:01.791619 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:01.798339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:01.799409 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:01.800825 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:02.041520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:02.055726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c974bb34-c7f6-4da3-a7e3-4ca29cb019cd tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.276434 Aug 02 10:18:02.059187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 131/253] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:01 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:03.094024 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:03.094627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:03.109738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:03.110223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:03.111024 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:03.111509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:03.574582 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:03.585154 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-53a82418-8d89-4e57-bf4b-e5ebf81395c1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.495211 Aug 02 10:18:03.585738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 123/254] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:03 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:04.461191 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9e5e1689-f348-41a2-b4b5-33901b53f31d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Action: 'create', calling method: .version_select at 0x7f5c0815c820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1446812736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4iXlkH+57UYxmjxr0Vf6e37FkXIblGlOX6BtxrQRNFVtIq3kqRSQhTyRg4D9Ph7KLc3k2HvnG1ze5OBFIK8EEgookzHuApZLkxSGHr+5gc1zO0O1hUr+agJLhfdsBOSw=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:04.498737 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-9e5e1689-f348-41a2-b4b5-33901b53f31d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Getting quotas for project bdbf0111b2d84f12b205134fde982ae4. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:18:04.503575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-9e5e1689-f348-41a2-b4b5-33901b53f31d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Getting quotas for user 54bb78d9af854abf845b47f2bb925b74 and project bdbf0111b2d84f12b205134fde982ae4. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:18:04.546882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9e5e1689-f348-41a2-b4b5-33901b53f31d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.089693 Aug 02 10:18:04.547801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 132/255] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:18:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:18:04.608929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:04.610404 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:04.621043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:04.622224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:04.623522 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:04.624176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:04.713471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-278346017", "imageRef": "8b31db62-f6ec-4745-ab5f-f84e670fe207", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1446812736", "networks": [{"uuid": "f03ca92f-8f25-430a-97e6-a5b917f42b45"}]}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:04.831741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:04.840790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b3f8586c-8b52-440b-9adb-550ebcaeb9e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.236265 Aug 02 10:18:04.841390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 124/256] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:04 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:04.858970 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] validate_networks() for [('f03ca92f-8f25-430a-97e6-a5b917f42b45', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:18:05.312179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:18:05.312699 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:18:05.313219 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:18:05.314116 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:18:05.314527 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:18:05.324024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:05.324723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:05.325914 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:05.326514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:05.345083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Getting quotas for project bdbf0111b2d84f12b205134fde982ae4. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:18:05.349606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Getting quotas for user 54bb78d9af854abf845b47f2bb925b74 and project bdbf0111b2d84f12b205134fde982ae4. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:18:05.362446 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:18:05.365363 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b31db62-f6ec-4745-ab5f-f84e670fe207',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:18:05.431595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-182fcf7b-8124-4251-a9b0-6fc1456e8064 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723379 Aug 02 10:18:05.432571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 133/257] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:18:05.443346 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5980e7c6-f877-4651-8b57-bfec90d55968 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:05.444003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5980e7c6-f877-4651-8b57-bfec90d55968 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:05.504404 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5980e7c6-f877-4651-8b57-bfec90d55968 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:05.517208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5980e7c6-f877-4651-8b57-bfec90d55968 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1258 microversion: 2.1 time: 0.077710 Aug 02 10:18:05.518040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 125/258] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:05 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:05.871895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:05.873114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:05.890191 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:05.890654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:05.891448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:05.891880 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:06.062830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:06.072692 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f89e947e-0369-492e-b1e6-73737f99c82b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.209696 Aug 02 10:18:06.073832 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 134/259] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:05 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:06.539412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:06.541213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:06.548712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:06.550003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:06.551147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:06.551922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:06.625519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:06.633332 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-20d54438-7702-4a98-bb29-20ca7f5550d7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1310 microversion: 2.1 time: 0.098756 Aug 02 10:18:06.634005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 126/260] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:06 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:07.095991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:07.096720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:07.103032 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:07.103563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:07.104584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:07.104953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:07.264918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:07.272375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ce652ce6-7dc7-4c83-9256-d354501869c8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.180953 Aug 02 10:18:07.273362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 135/261] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:07 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:07.657575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:07.658412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:07.664828 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:07.665470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:07.666501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:07.666936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:07.751075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:07.762201 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-10c1358c-48bd-4964-bc33-5ff1561ed429 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1318 microversion: 2.1 time: 0.109129 Aug 02 10:18:07.762785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 127/262] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:07 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:08.299339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:08.300164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:08.302460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:08.309954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:08.310436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:08.311648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:08.312549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:08.325090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=85 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:08.784855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:08.798280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:08.808682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:08.809518 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:08.810760 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:08.811578 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:08.895248 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:08.913497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-12ab9a85-1b03-42c6-a7ed-ed30b3b99d29 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.618130 Aug 02 10:18:08.915931 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 136/263] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:08 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:08.961151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:08.971829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-07394db0-5853-4281-a5b4-6f86f7457ed0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1316 microversion: 2.1 time: 0.191751 Aug 02 10:18:08.972913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 128/264] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:08 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:09.942128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:09.942904 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:09.958194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:09.961379 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:09.964313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:09.967025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:09.997086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:09.999949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:10.019823 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:10.020267 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:10.021044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:10.022492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:10.411280 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:10.432392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-08bb33c2-6047-459f-80a9-01c993ba4912 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.496554 Aug 02 10:18:10.439993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 137/265] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:09 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:10.478265 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:10.486511 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4fdac414-4d44-4ce5-8fea-33a967b5c72a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.493679 Aug 02 10:18:10.487668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 129/266] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:09 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:11.470731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:11.472728 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:11.486294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:11.486746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:11.487596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:11.487971 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:11.510689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:11.512571 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:11.528744 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:11.530904 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:11.534071 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:11.535888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:11.999395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:12.012593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-53f4ac7e-b241-49c8-bc2a-6d25e6343324 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.551890 Aug 02 10:18:12.028532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 138/267] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:11 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:12.098701 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:12.111871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d17e75d1-ef09-4b2a-9faf-22de2a064ee4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.606282 Aug 02 10:18:12.113805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 130/268] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:11 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:13.038008 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:13.040544 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:13.059376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:13.061190 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:13.062621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:13.063957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:13.134969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:13.135667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:13.139610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:13.153166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:13.154030 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:13.155534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:13.170659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:13.344285 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:13.356246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-fac474fb-3cc8-410f-96ab-fef058ae240c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.323544 Aug 02 10:18:13.356825 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 139/269] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:13 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:13.412374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:13.420246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0569fe95-537c-41f3-a728-8fd864ced35f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.289658 Aug 02 10:18:13.420817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 131/270] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:13 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:13.747516 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-338579659", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "networks": [{"uuid": "1967c145-b8f4-4815-a5fd-b82cd154be4a"}]}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:14.076949 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] validate_networks() for [('1967c145-b8f4-4815-a5fd-b82cd154be4a', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:18:14.380148 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:14.382019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:14.392462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:14.393328 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:14.394446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:14.395038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:14.612183 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:18:14.613199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:18:14.613686 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:18:14.614128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:18:14.614549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:18:14.642761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:14.643446 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:14.644421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:14.645126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:14.659406 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:14.669036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Getting quotas for project b83d3a9d900c4e9383fa88fd1475c029. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:18:14.671536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d2246671-4478-4a3f-9a71-b88c4c74f7ff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.293107 Aug 02 10:18:14.672807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 132/271] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:14 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:14.674727 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Getting quotas for user a5f2ec904f214a708a3691da24fb516d and project b83d3a9d900c4e9383fa88fd1475c029. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:18:14.677352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:14.677997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:14.687173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:18:14.688822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:14.688927 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:14.690493 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:18:14.693810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:14.694374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:14.776203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c79dd365-295c-43c6-9844-a997ce2b6ec5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031311 Aug 02 10:18:14.777553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 140/272] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:18:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:18:14.794784 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9754ce47-e26c-416e-8e06-bfd0e67981e1 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:14.796334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9754ce47-e26c-416e-8e06-bfd0e67981e1 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:14.926382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9754ce47-e26c-416e-8e06-bfd0e67981e1 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:14.933754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9754ce47-e26c-416e-8e06-bfd0e67981e1 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1213 microversion: 2.1 time: 0.148531 Aug 02 10:18:14.946066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 141/273] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:14 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:15.051601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:15.061159 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fdab4c50-5843-45e5-a832-07c237f2cb42 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.386797 Aug 02 10:18:15.066123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 133/274] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:14 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:15.693981 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:15.694601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:15.701019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:15.701466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:15.702277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:15.702718 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:15.847916 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:15.855729 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ac0d6e72-4017-4244-9985-d9f30620c647 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.165684 Aug 02 10:18:15.856378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 142/275] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:15 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:15.959117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:15.959824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:15.962120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:15.967698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:15.968386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:15.969259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:15.969694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:16.034438 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:16.041971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b7ab8d56-75a5-4deb-86da-20aa2119db84 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.086960 Aug 02 10:18:16.042580 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 134/276] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:15 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:16.082479 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:16.083095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:16.089497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:16.089985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:16.090765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:16.091200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:16.227250 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:16.234857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4a5bb94a-728d-4cd4-80ed-3ad0d7da7fbc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.156250 Aug 02 10:18:16.235425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 143/277] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:16 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:16.876630 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:16.877253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:16.888196 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:16.889143 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:16.889955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:16.890418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:17.039442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:17.047972 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0baaf7ef-2f11-40ae-a3e1-49f59d3dcab1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.175182 Aug 02 10:18:17.048545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 135/278] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:16 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:17.064171 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:17.064880 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:17.071620 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:17.072153 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:17.073010 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:17.073517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:17.140724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:17.148228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-dc5e6eec-ce1e-45a6-927d-02551d7826de tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.087874 Aug 02 10:18:17.148789 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 144/279] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:17 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:17.255402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:17.256018 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:17.262043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:17.262498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:17.263263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:17.264382 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:17.268254 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:17.399154 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:17.406812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a1c7959c-3990-49bf-beb8-cf2186a34e98 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.155225 Aug 02 10:18:17.407410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 136/280] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:17 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:18.072004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:18.073429 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:18.085663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:18.086442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:18.088397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:18.089631 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:18.171101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:18.171716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:18.189288 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:18.189737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:18.190781 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:18.191228 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:18.288989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:18.310269 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b203f3eb-5390-4084-bdc8-270d6b0ca542 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.143085 Aug 02 10:18:18.311456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 137/281] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:18 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:18.429254 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:18.430192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:18.438037 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:18.439124 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:18.440106 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:18.440704 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:18.602184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:18.610988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2a4738e8-259e-473f-876e-95ab9da22d80 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.543705 Aug 02 10:18:18.611503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 145/282] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:18 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:18.693054 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:18.700731 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5486217e-6ea6-4bdc-9b47-0be5709fdbe5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.276160 Aug 02 10:18:18.701336 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 138/283] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:18 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:19.332389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:19.333035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:19.339290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:19.339738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:19.340500 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:19.340939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:19.415467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:19.423334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-528ee8be-8dee-4342-b31b-4d2a2110dafa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.094820 Aug 02 10:18:19.433294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 146/284] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:19 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:19.634129 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:19.636672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:19.647430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:19.648750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:19.649963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:19.650503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:19.722113 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:19.725193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:19.732283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:19.733279 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:19.734103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:19.734543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:19.874294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:19.886404 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2ad39e06-67a9-40b3-a68f-647fcc2ffa0e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.256967 Aug 02 10:18:19.887238 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 139/285] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:19 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:19.914992 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:19.923132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0cd79f7a-3b55-482f-8fea-7fb20c4b6553 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.205396 Aug 02 10:18:19.924029 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 147/286] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:19 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:20.454215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:20.454872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:20.461410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:20.461893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:20.462869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:20.463461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:20.538157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:20.548162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b95b4f45-4f77-49ea-8251-c24e67747c48 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.098099 Aug 02 10:18:20.549110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 140/287] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:20 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:20.906884 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:20.907489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:20.913487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:20.913967 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:20.914718 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:20.915145 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:20.945815 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:20.947211 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:20.955085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:20.956031 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:20.957065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:20.957715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:21.120984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:21.128481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d3491034-19f5-4e92-8874-63424df4e501 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.225629 Aug 02 10:18:21.129050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 148/288] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:20 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:21.148220 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:21.159197 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-28cbc1df-d401-4b20-98ae-609d37ffb157 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.217253 Aug 02 10:18:21.160020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 141/289] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:20 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:21.570262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:21.570886 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:21.576831 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:21.577303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:21.578097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:21.578535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:21.646014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:21.653954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-45bafcac-085f-4939-999f-3fdb99236523 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.088395 Aug 02 10:18:21.655078 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 149/290] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:21 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:22.150506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:22.151149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:22.158713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:22.159167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:22.159986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:22.160426 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:22.181705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:22.182387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:22.189281 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:22.189734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:22.190543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:22.190988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:22.347984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:22.359302 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ce40a8dc-ad38-498a-908a-77e8b2b5e14b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.182558 Aug 02 10:18:22.360014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 150/291] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:22 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:22.447439 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:22.454961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f8632558-a463-4650-aaf7-8ed065a77c12 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.308531 Aug 02 10:18:22.455524 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 142/292] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:22 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:22.675712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:22.676328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:22.682712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:22.683161 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:22.683926 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:22.684364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:22.893121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:22.900592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8a002a9c-adb8-4bea-b061-7cead59a477f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.228770 Aug 02 10:18:22.901190 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 151/293] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:22 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:23.380102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:23.380718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:23.387246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:23.387699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:23.388477 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:23.389419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:23.479200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:23.480585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:23.488549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:23.489247 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:23.490056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:23.490640 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:23.530703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:23.538550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8280c049-c41c-493e-84bd-0391f6346181 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.162272 Aug 02 10:18:23.539119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 143/294] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:23 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:23.632057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:23.640824 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6e2413c4-81bf-4c48-9109-63c21df3b3b0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.167857 Aug 02 10:18:23.641877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 152/295] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:23 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:23.922037 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:23.922669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:23.928928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:23.929380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:23.930183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:23.930623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:23.995006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:24.003424 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-89ba4aa6-6cac-42ed-9e4d-fb5df85ef7b2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.085256 Aug 02 10:18:24.003981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 144/296] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:23 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:24.559756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:24.560542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:24.566962 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:24.567411 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:24.568179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:24.568613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:24.656268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=4 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:24.662915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:24.663592 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:24.675056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:24.676037 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:24.676846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:24.677500 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:24.710449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:24.719672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-646c13ca-8acb-4def-94be-e686622694ca tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.164297 Aug 02 10:18:24.720548 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 153/297] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:24 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:24.829185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:24.836686 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8dd140d0-7c39-4511-8487-365341cb7677 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.177903 Aug 02 10:18:24.837471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 145/298] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:24 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:25.026345 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:25.026953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:25.028871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=18 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:25.035816 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:25.036321 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:25.037201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:25.037843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:25.053473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:25.103262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:25.111586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-574cdfa3-f597-467b-bab0-15f0ee1b18fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.090549 Aug 02 10:18:25.118297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 154/299] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:25 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:25.740214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:25.741088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:25.747663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:25.748242 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:25.749737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:25.750212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:25.861594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:25.862380 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:25.868487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:25.868929 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:25.869778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:25.870256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:25.898499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:25.906264 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-da1201db-4a33-4095-a8a6-9dd7e2ab8fa8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.169789 Aug 02 10:18:25.906987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 146/300] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:25 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:26.018481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:26.027039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1ed4c6ff-1505-4ad6-94ed-43028867f3d9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.171776 Aug 02 10:18:26.027527 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 155/301] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:25 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:26.132819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:26.133549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:26.139675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:26.140135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:26.140909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:26.141349 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:26.204838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:26.212205 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3995eb2b-7083-4ffa-8e47-26a9e2ba6492 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.083534 Aug 02 10:18:26.212766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 147/302] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:26 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:26.926682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:26.927310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:26.934092 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:26.934544 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:26.935308 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:26.936254 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:27.048848 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:27.050175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:27.058263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:27.059229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:27.061289 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:27.061959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:27.075536 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:27.084502 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ed3b3cc2-943e-4d65-8d75-6ea8f90395e1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.161745 Aug 02 10:18:27.085563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 156/303] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:26 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:27.198963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:27.206460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8f3d73f4-d121-4d41-bf09-8899ce119f85 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.161636 Aug 02 10:18:27.207010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 148/304] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:27 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:27.233738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:27.234412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:27.240555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:27.241117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:27.241914 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:27.242348 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:27.307153 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:27.315310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-238f8b3f-a6ff-403f-98d0-ea54913cfc02 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.086080 Aug 02 10:18:27.315863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 157/305] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:27 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:28.104734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:28.105466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:28.112162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:28.112811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:28.113604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:28.114126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:28.235523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:28.236147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:28.242567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:28.243017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:28.243816 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:28.244513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:28.324650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:28.335610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6230369c-095e-4567-bda4-7d4863a0e3f9 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.234162 Aug 02 10:18:28.336619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 149/306] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:28 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:28.349776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:28.354442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:28.361249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:28.361928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:28.363048 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:28.363413 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:28.402256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:28.416121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d06129cc-f391-43b9-83b8-02b6b86d7d34 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.192263 Aug 02 10:18:28.429389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 158/307] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:28 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:28.434356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:28.442734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-40f974c5-b4c1-4f83-9e84-b25115a26250 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.104999 Aug 02 10:18:28.446496 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 150/308] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:28 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:29.358213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:29.359477 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:29.366178 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:29.366641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:29.367454 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:29.367891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:29.436666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:29.437423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:29.449706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:29.450377 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:29.452011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:29.452456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:29.581855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:29.589742 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f7002a61-079e-4fa6-b648-1aecab3fa5f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.235904 Aug 02 10:18:29.590342 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 159/309] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:29 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:29.595394 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:29.595999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:29.601881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:29.602329 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:29.603085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:29.603530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:29.626463 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:29.633919 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6f843ba5-5cdd-43d7-b666-bd72a69d49a5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.201148 Aug 02 10:18:29.634489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 151/310] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:29 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:29.665959 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:29.673604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8276d25b-7ead-460b-b1c0-4ebdcf6304bf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.082294 Aug 02 10:18:29.674185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 160/311] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:29 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:30.611000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:30.611624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:30.618151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:30.618613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:30.619383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:30.619826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:30.655339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:30.655950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:30.662168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:30.662618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:30.663387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:30.663822 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:30.802067 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:30.805420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:30.811572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1b55c4f9-ba91-49eb-bb6d-67262d2fdf39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.203933 Aug 02 10:18:30.812372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 152/312] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:30 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:30.817149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:30.817897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:30.824301 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:30.825039 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:30.825998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:30.826719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:30.849993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:30.856482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9595bd67-43ae-4a1e-bc09-c4369ee338db tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.205011 Aug 02 10:18:30.857099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 161/313] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:30 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:30.895384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:30.902918 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a0526c9c-a198-460b-ae25-b2f13198ee46 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.089303 Aug 02 10:18:30.903483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 153/314] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:30 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:31.833307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:31.833874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:31.840139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:31.840680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:31.841392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:31.841855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:31.877901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:31.878710 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:31.885594 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:31.886192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:31.887252 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:31.888152 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:32.055098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:32.063445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b9ed1804-ff63-4723-9b8d-bef3baefb970 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.234104 Aug 02 10:18:32.064027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 162/315] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:31 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:32.079177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:32.081091 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:32.081698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:32.086713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7b113e74-4453-40bc-b5b5-449033ce06ba tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.212876 Aug 02 10:18:32.087212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 154/316] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:31 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:32.087649 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:32.088240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:32.088975 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:32.089541 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:32.153698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:32.161159 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-20570bfb-ef1a-4587-803e-bd5f87b78135 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.084466 Aug 02 10:18:32.161708 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 163/317] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:32 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:33.084150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:33.084887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:33.091274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.091729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.092569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.093009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.108441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:33.109187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:33.115455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.115902 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.116661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.117318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.386456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:33.393812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-49388764-3997-4103-8042-5c7fa422123d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.313502 Aug 02 10:18:33.394374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 155/318] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:33 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:33.398949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:33.399551 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:33.405372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.406110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.406610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.407044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.425642 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:33.433237 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9bd09b1b-703d-4891-8cd0-1318fec3354c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.329535 Aug 02 10:18:33.434134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 164/319] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:33 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:33.495702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:33.503114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-20d76ac0-f9c8-4ae8-9fd1-6565ec5b52d5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1217 microversion: 2.1 time: 0.107779 Aug 02 10:18:33.503676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 156/320] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:33 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:33.674102 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-ca002d88-6543-49a0-a653-a17eaa5f5591 req-23cf2e0b-6487-4568-8681-6e3708a45fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:33.683782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ca002d88-6543-49a0-a653-a17eaa5f5591 req-23cf2e0b-6487-4568-8681-6e3708a45fa4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:33.684225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ca002d88-6543-49a0-a653-a17eaa5f5591 req-23cf2e0b-6487-4568-8681-6e3708a45fa4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:33.697148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-ca002d88-6543-49a0-a653-a17eaa5f5591 req-23cf2e0b-6487-4568-8681-6e3708a45fa4 service nova] Creating event network-changed:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:18:33.702152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-ca002d88-6543-49a0-a653-a17eaa5f5591 req-23cf2e0b-6487-4568-8681-6e3708a45fa4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032251 Aug 02 10:18:33.702763 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 165/321] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:18:34.415011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:34.415535 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:34.422137 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:34.422625 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:34.423415 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:34.423860 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:34.456177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:34.456967 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:34.463530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:34.464220 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:34.465030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:34.465594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:34.670205 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:34.679399 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-43f4e7e3-ab1b-48e9-919f-908db90db882 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.269241 Aug 02 10:18:34.680132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 157/322] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:34 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:34.686023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:34.687478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:34.690868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:34.694538 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:34.695229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:34.696363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:34.697113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:34.698639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bfbab7fb-f509-4355-8b5a-f9dce2659122 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1522 microversion: 2.1 time: 0.247339 Aug 02 10:18:34.699209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 166/323] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:34 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:34.772929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:34.780467 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b9a836e2-c4c3-4d42-9c78-52d381513662 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1273 microversion: 2.1 time: 0.099226 Aug 02 10:18:34.781027 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 158/324] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:34 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:35.702359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:35.702993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:35.709233 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:35.709684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:35.710491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:35.710926 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:35.720866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:35.721619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:35.728458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:35.728997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:35.729825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:35.730245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:36.069387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:36.072153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:36.079786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-259f28fa-71ca-4fac-b856-ef0febf343da tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.381242 Aug 02 10:18:36.080838 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 167/325] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:35 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:36.082976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ab2a786e-1864-4ebb-901b-c4f21d6848cc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1502 microversion: 2.1 time: 0.366008 Aug 02 10:18:36.085882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:36.086660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:36.093251 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:36.094203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:36.095495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:36.096157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:36.099663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 159/326] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:35 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1502 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:36.107658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:36.109013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:36.116481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:36.117198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:36.118597 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:36.119026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:36.505841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:36.514287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ce014273-15d6-40e6-a593-1eea7bdc06cc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1271 microversion: 2.1 time: 0.432199 Aug 02 10:18:36.514866 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 168/327] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:36 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1271 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:36.743016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:36.754989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-75050ad0-6259-4b98-a9c9-fa8d44b380d3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1515 microversion: 2.1 time: 0.653713 Aug 02 10:18:36.755890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 160/328] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:36 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1515 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:37.103665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:37.104429 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:37.112461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:37.115251 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:37.117210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:37.119815 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:37.233000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-552683094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1707332186", "security_groups": [{"name": "tempest-secgroup-smoke-1387744871"}], "networks": [{"uuid": "3c48514e-bdb8-4dca-9106-6dfe9ebb5775"}], "block_device_mapping_v2": [{"uuid": "1fee12b1-f3a6-4581-8f9a-a6d983db5d55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:37.275370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:37.283240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3f1e6ea0-db82-4c12-a37f-e423e17e78ab tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.184493 Aug 02 10:18:37.284195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 169/329] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:37 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:37.360877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] validate_networks() for [('3c48514e-bdb8-4dca-9106-6dfe9ebb5775', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:18:37.540485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:37.541100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:37.548082 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:37.548533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:37.549479 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:37.550131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:37.785354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:37.795957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cdbbe8e6-5658-417c-ad3e-84084c58162f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.259067 Aug 02 10:18:37.797016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 170/330] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:37 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:37.843223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:18:37.843692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:18:37.844119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:18:37.844530 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:18:37.844942 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:18:37.856792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:37.856946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:37.858666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:37.859881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:37.893141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Getting quotas for project 99a92325ab3d4ec2bbecffb9a6e609d5. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:18:37.897660 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Getting quotas for user 7b672b80961445c3a3a9b2d784f64208 and project 99a92325ab3d4ec2bbecffb9a6e609d5. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:18:37.961979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:18:37.964071 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fee12b1-f3a6-4581-8f9a-a6d983db5d55',volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:18:38.140213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-82f842c7-b640-4f68-b1b0-b48ce655dfe2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.911275 Aug 02 10:18:38.141314 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 161/331] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:18:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:18:38.152891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-109bc06b-9563-4507-bf39-1a1c00ec9001 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:38.154387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-109bc06b-9563-4507-bf39-1a1c00ec9001 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:38.251233 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-109bc06b-9563-4507-bf39-1a1c00ec9001 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:38.259067 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-109bc06b-9563-4507-bf39-1a1c00ec9001 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1088 microversion: 2.1 time: 0.110784 Aug 02 10:18:38.260056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 171/332] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:38 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1088 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:38.304411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:38.305088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:38.311809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:38.312222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:38.313007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:38.313426 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:38.472160 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:38.480690 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e75dbeb0-d7a6-4756-9dce-b6d3a02d9ca7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.179934 Aug 02 10:18:38.481414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 162/333] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:38 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:38.817638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:38.818684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:38.820933 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:38.827758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:38.828249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:38.829045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:38.829480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:38.963764 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:38.966102 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:38.972552 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e42fae6c-2e7e-4c41-af06-3204ecd58774 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.159201 Aug 02 10:18:38.973213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 172/334] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:38 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:39.261486 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:39.263849 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:39.270408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.270857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.271769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.272276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.282360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:39.283059 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:39.289063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.289515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.290345 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.290817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.296689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lazy-loading 'flavor' on Instance uuid 1df5b287-bdb5-44e4-bbca-22bf77e34aad {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:18:39.355687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:39.363371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0a1411cc-2b47-4cd9-b233-63c003a3c573 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1138 microversion: 2.1 time: 0.084978 Aug 02 10:18:39.363950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 173/335] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:39 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:39.407637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-49bef67d-0f01-491f-8d17-970e223ca31b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/action" status: 200 len: 32 microversion: 2.1 time: 0.150032 Aug 02 10:18:39.408269 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 163/336] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:18:39 2022] POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:18:39.417909 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:39.418466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:39.424600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.425053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.425851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.426293 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.507325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:39.508038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:39.514513 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.515478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.516267 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:39.516690 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:39.557510 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:39.568036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-316711f1-884c-46e0-8dfc-2bc4908a7413 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.154101 Aug 02 10:18:39.568605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 174/337] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:39 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:39.652594 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:39.660985 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3e87b28b-755f-4979-bebd-cba259b7db3c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.158546 Aug 02 10:18:39.661547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 164/338] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:39 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:39.994018 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:39.994818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:40.001477 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.002006 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.002793 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.003270 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.225751 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:40.257961 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c140fbcf-a50f-4f64-b7ae-5fd87e391b14 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.267957 Aug 02 10:18:40.271230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 175/339] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:39 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:40.385534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:40.386198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:40.398450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.399129 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.400085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.400757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.594516 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:40.595118 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:40.602355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.602804 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.603574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.604473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.656106 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:40.667872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7a66836c-76b4-4f32-9c26-3409e2fba060 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1194 microversion: 2.1 time: 0.286971 Aug 02 10:18:40.687623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 165/340] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:40 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:40.687623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:40.687623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:40.698244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.698918 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:40.699770 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:40.700533 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:41.070918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:41.079235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c7f1a79b-21f8-4205-be11-c36c3dd7a24c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.492736 Aug 02 10:18:41.079806 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 176/341] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:40 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:41.090596 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:41.098193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4b5771cd-3478-4b21-8d34-2e12ce45b2f5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.419137 Aug 02 10:18:41.098869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 166/342] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:40 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:41.155389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-b1739091-e3a2-4abd-ac8f-6b7f7f18f3f4 req-21146097-93b3-4d6c-974b-9f9ef98f223d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2038be26-c80e-4a20-9e1a-7d1e934fc85a", "tag": "becba994-ae6a-4325-bb4d-34342b50eadc"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:41.165148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-b1739091-e3a2-4abd-ac8f-6b7f7f18f3f4 req-21146097-93b3-4d6c-974b-9f9ef98f223d service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:41.165661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-b1739091-e3a2-4abd-ac8f-6b7f7f18f3f4 req-21146097-93b3-4d6c-974b-9f9ef98f223d service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:41.176920 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-b1739091-e3a2-4abd-ac8f-6b7f7f18f3f4 req-21146097-93b3-4d6c-974b-9f9ef98f223d service nova] Creating event network-changed:becba994-ae6a-4325-bb4d-34342b50eadc for instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a on hv-cinder-84713 Aug 02 10:18:41.183221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-b1739091-e3a2-4abd-ac8f-6b7f7f18f3f4 req-21146097-93b3-4d6c-974b-9f9ef98f223d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031506 Aug 02 10:18:41.183754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 177/343] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:18:41.292663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:41.293200 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:41.299911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:41.300360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:41.301118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:41.301553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:41.570703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:41.578660 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6f2cfe98-0d87-410a-8d4f-f5014666a766 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.289876 Aug 02 10:18:41.579226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 167/344] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:41 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:41.701055 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:41.702287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:41.708470 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:41.708915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:41.709671 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:41.710138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:41.774290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:41.782121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0d6d7342-e420-451b-9f38-92290d461faa tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1204 microversion: 2.1 time: 0.086850 Aug 02 10:18:41.782689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 178/345] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:41 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:42.100509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:42.101237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:42.107293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.107673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.108957 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.109392 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.113388 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:42.119104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:42.119720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:42.126567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.127092 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.127892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.128332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.313407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:42.317891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:42.322006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0befe72b-32b2-4214-b4f1-7aa3ae8f7d24 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.225236 Aug 02 10:18:42.322589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 168/346] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:42 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:42.325533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-31e2c825-a3fc-4079-bfc4-07602a85d8ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.210293 Aug 02 10:18:42.326112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 179/347] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:42 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:42.599457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:42.600247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:42.606729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.607173 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.607939 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.608958 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.737570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:42.744956 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5a2b2190-561e-481c-a842-e3a081ee8518 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.149329 Aug 02 10:18:42.745517 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 169/348] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:42 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:42.803109 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:42.803646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:42.810133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.810582 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.811366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:42.811797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:42.876941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:42.884416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ddb340fc-cffd-4bba-a494-6f16da6e1a50 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1204 microversion: 2.1 time: 0.085216 Aug 02 10:18:42.884977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 180/349] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:42 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:43.343727 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:43.344342 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:43.346089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:43.346210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:43.346711 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:43.351540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.351917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.352684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.352995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.353125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.353453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.354318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.354848 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.549951 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:43.551711 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:43.559772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-03f1fe89-4ff3-4fbb-9696-1e8a466d7960 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.217987 Aug 02 10:18:43.560787 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 181/350] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:43 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:43.560895 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-aa49c3b6-7f12-40cb-a9c1-830e6b1f43fb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.221299 Aug 02 10:18:43.561812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 170/351] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:43 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:43.766616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:43.768183 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:43.774211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.774656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.775403 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.776012 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.905934 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:43.906782 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:43.913602 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.914084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.914858 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:43.915157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:43.915653 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:43.922665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-30820f9d-2b9d-4d67-8d97-f02f14934146 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.160441 Aug 02 10:18:43.923236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 182/352] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:43 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:43.977924 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:43.985331 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2128a5fe-ddc7-4829-87dc-72404d4fe9ff tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1204 microversion: 2.1 time: 0.084656 Aug 02 10:18:43.985914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 171/353] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:43 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:44.580377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:44.580910 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:44.581955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:44.582576 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:44.587169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:44.587619 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:44.588388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:44.588502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:44.588833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:44.588949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:44.589702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:44.590184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:44.788730 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:44.791769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:44.797008 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-944357bf-e1e2-49cf-9fc3-744f9b14d96e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.220492 Aug 02 10:18:44.797671 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 183/354] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:44 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:44.800792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-63349d99-9136-49f7-83ef-4a1fdf84417f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.222652 Aug 02 10:18:44.801367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 172/355] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:44 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:44.945482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:44.952725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:44.959817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:44.960496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:44.961467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:44.961998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:45.009928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:45.010666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:45.018495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:45.018953 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:45.019737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:45.020181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:45.123669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:45.132063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ac6ebe33-fae4-4169-b614-c97f5f5e6bd1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1204 microversion: 2.1 time: 0.130056 Aug 02 10:18:45.132643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 173/356] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:45 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:45.212943 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:45.220947 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-36f86c17-ec0f-4fa2-926e-da4ec8ee99aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.280670 Aug 02 10:18:45.221639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 184/357] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:44 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:45.819241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:45.819864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:45.837668 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:45.838209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:45.841085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:45.841546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:45.842435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:45.844987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:45.855943 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:45.856533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:45.857457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:45.858674 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:46.230963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:46.244088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-effbf9eb-038d-4ea2-a79d-1b1dcfa7a065 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.429741 Aug 02 10:18:46.244785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 174/358] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:45 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:46.256184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:46.263878 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:46.264867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:46.272022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:46.272778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:46.273744 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:46.274028 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-edc37602-7220-44f7-a4d1-ee0fb3a46d46 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.454239 Aug 02 10:18:46.274352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:46.275631 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 185/359] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:45 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:46.286670 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:46.288002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:46.298234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:46.298940 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:46.300391 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:46.300940 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:46.595569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:46.602850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-42ff878e-8117-4f4e-9ac4-1dc10435dbbc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1272 microversion: 2.1 time: 0.347695 Aug 02 10:18:46.603406 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 175/360] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:46 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1272 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:46.609283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:46.624246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1f11c680-cb98-4f45-a825-7ec4d92707aa tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.345509 Aug 02 10:18:46.625036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 186/361] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:46 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:47.027996 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-34f735e5-505d-4da6-ae51-72f0e618e03c req-b48b149b-c223-4099-8c27-eaccd876612d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:47.037833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-34f735e5-505d-4da6-ae51-72f0e618e03c req-b48b149b-c223-4099-8c27-eaccd876612d service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.038280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-34f735e5-505d-4da6-ae51-72f0e618e03c req-b48b149b-c223-4099-8c27-eaccd876612d service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.049354 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-34f735e5-505d-4da6-ae51-72f0e618e03c req-b48b149b-c223-4099-8c27-eaccd876612d service nova] Creating event network-changed:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:18:47.054764 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-34f735e5-505d-4da6-ae51-72f0e618e03c req-b48b149b-c223-4099-8c27-eaccd876612d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030435 Aug 02 10:18:47.055718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 176/362] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:18:47.266895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:47.267506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:47.273508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.274006 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.274987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.275205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.297542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:47.298475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:47.304755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.305191 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.306073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.306585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.475611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:47.483769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2ff091ff-c15c-4e7a-bb1c-0609b99faafe tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.220840 Aug 02 10:18:47.484336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 187/363] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:47 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:47.494375 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:47.494849 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6391a305-67bd-4a1e-a8d1-091f7f10f48d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.202170 Aug 02 10:18:47.495394 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 177/364] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:47 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:47.624424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:47.625077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:47.631091 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.631532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.632282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.632713 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.645754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:47.646329 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:47.652281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.652735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.653514 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:47.654039 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:47.837457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:47.844347 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:47.845042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-dc9ae886-acd2-4911-b110-829eb8cde966 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.224943 Aug 02 10:18:47.847108 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 188/365] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:47 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:47.852141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6d7a403f-4348-47e0-a911-3d919e7002a6 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.210214 Aug 02 10:18:47.852865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 178/366] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:47 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:48.504588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:48.505199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:48.507163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:48.512707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.513155 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.513957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.514411 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.516361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:48.517040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:48.518974 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:48.519698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:48.526451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.526905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.527678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.528114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.728204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:48.731201 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:48.736061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6367e830-b8fc-43c7-b4bb-bf55c65433fa tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.235403 Aug 02 10:18:48.736634 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 189/367] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:48 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:48.739139 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b5423488-7e68-4d2b-bdc0-0134d86e89ed tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.226642 Aug 02 10:18:48.739696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 179/368] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:48 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:48.868060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:48.868676 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:48.872305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:48.872923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:48.875497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.875951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.876734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.877173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.879614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.880065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.880844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:48.881955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:48.882112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:49.087972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:49.096176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:49.097290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-18d34e5e-8cea-4417-ac9d-b89cb8e2bc5d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.233086 Aug 02 10:18:49.097957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 190/369] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:48 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:49.103612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9a2c5a93-bd42-457b-8a65-b5a62dc8610d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.235225 Aug 02 10:18:49.104169 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 180/370] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:48 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:49.756958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:49.757847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:49.760741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:49.761259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:49.764058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:49.764490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:49.765276 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:49.765709 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:49.767886 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:49.768337 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:49.769125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:49.769842 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:49.965404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:49.970160 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:49.973647 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5b78a038-a778-482d-ba1e-b87814f51cae tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.220599 Aug 02 10:18:49.974451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 191/371] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:49 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:49.979706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3298662d-d467-4a57-b5b3-4507b7b5cf2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.223124 Aug 02 10:18:49.990726 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 181/372] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:49 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:50.118162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:50.118707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:50.123240 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:50.124380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:50.126373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:50.126827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:50.127621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:50.128203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:50.130580 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:50.131019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:50.131793 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:50.132224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:50.339442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:50.342754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:50.347011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-30893ea3-f366-452f-ab8a-8b4a8244b1cf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.233042 Aug 02 10:18:50.347583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 192/373] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:50 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:50.350667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3d29887d-a009-4ed1-a050-7e10ae6d7e61 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.231266 Aug 02 10:18:50.351322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 182/374] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:50 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:50.995101 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:50.995741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:51.002371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.002734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:51.003192 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.003363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:51.003570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.004015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.009977 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.010440 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.011204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.011645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.203542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:51.207390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:51.211381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e7855b11-cc96-4595-9d23-250a4d719487 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.220087 Aug 02 10:18:51.211961 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 193/375] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:50 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:51.214811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-064d833d-b43f-42a9-9529-83910ec41cc5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.216468 Aug 02 10:18:51.215639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 183/376] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:50 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:51.368389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:51.369314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:51.371668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:51.372281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:51.376428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.376882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.377723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.378223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.378795 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.379244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.380008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:51.380445 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:51.573995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:51.576859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:51.581814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6a7a289d-ac09-49be-82f7-10b2f6378c2f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.217316 Aug 02 10:18:51.582480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 194/377] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:51 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:51.584270 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-433fb1c6-4ef6-4e5d-b86d-5f131d47d2d0 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.216369 Aug 02 10:18:51.584893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 184/378] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:51 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:52.232460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:52.233081 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:52.235549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:52.236162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:52.239361 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.239816 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.240588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.241030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.243226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.243226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.245369 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.245369 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.264052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:52.428127 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:52.435838 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a3d17737-6133-4f96-927a-84b3e09a3a0b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.207316 Aug 02 10:18:52.436408 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 195/379] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:52 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:52.445986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:52.455121 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f56f8289-ab86-4403-96f2-4a6260f75d9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.223319 Aug 02 10:18:52.455679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 185/380] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:52 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:52.603201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:52.603738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:52.605287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:52.605936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:52.610565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.611022 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.611801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.612248 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.615011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.615469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.616448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:52.616927 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:52.838103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:52.840590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:52.849244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4177801c-8946-45e1-ac78-4a9346380993 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.247335 Aug 02 10:18:52.849244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 196/381] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:52 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:52.849573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5eea5c48-78f4-49a2-88ea-2f3e48294f91 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.247101 Aug 02 10:18:52.849573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 186/382] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:52 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:53.457044 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:53.457661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:53.463653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.464099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.464860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.465291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.475991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:53.476599 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:53.483020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.483468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.484225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.484654 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.739828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:53.747224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d498c46f-3b2a-4d85-bf16-2bcabef7c1d8 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.293975 Aug 02 10:18:53.747800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 197/383] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:53 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:53.764410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:53.772727 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-70d727c5-8a5c-4725-8375-721e3a5a31af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.300462 Aug 02 10:18:53.773304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 187/384] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:53 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:53.875636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:53.876112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:53.876976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:53.877682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:53.889210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.891865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.892427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.892959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.894631 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.894863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:53.895530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:53.896065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:54.574626 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:54.584030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9cb843c3-7dac-4248-b4d3-b378fdcaa7cd tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.717181 Aug 02 10:18:54.584621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 198/385] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:53 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:54.590533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-c001a8a2-45e2-4982-9cfb-75d1c6db3f03 req-d93a1b48-5947-48c0-85df-0ddc937ba5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "name": "network-vif-plugged", "status": "completed", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:18:54.596696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:54.601433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-c001a8a2-45e2-4982-9cfb-75d1c6db3f03 req-d93a1b48-5947-48c0-85df-0ddc937ba5a7 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:54.601893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-c001a8a2-45e2-4982-9cfb-75d1c6db3f03 req-d93a1b48-5947-48c0-85df-0ddc937ba5a7 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:54.604798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-67ab1512-14eb-4fbe-a51d-4f55f7479ab9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.739321 Aug 02 10:18:54.606357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 188/386] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:53 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:54.614432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-c001a8a2-45e2-4982-9cfb-75d1c6db3f03 req-d93a1b48-5947-48c0-85df-0ddc937ba5a7 service nova] Creating event network-vif-plugged:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:18:54.619281 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-c001a8a2-45e2-4982-9cfb-75d1c6db3f03 req-d93a1b48-5947-48c0-85df-0ddc937ba5a7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Aug 02 10:18:54.620013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 199/387] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:18:54.769889 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:54.770437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:54.776423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:54.776879 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:54.777627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:54.778081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:54.795656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:54.797104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:54.804138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:54.804600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:54.805376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:54.805910 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:54.997503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:55.005285 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-82a5ab17-bc76-40dc-89f3-c21c3be4f31e tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.240676 Aug 02 10:18:55.005892 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 189/388] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:54 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:55.009052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:55.017978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4e797014-89d4-436b-a47e-eb15a009fd54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.227339 Aug 02 10:18:55.018807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 200/389] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:54 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:55.604563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:55.605225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:55.612798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:55.613242 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:55.614046 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:55.614482 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:55.627472 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:55.628090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:55.634046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:55.634502 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:55.635286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:55.635716 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:55.814545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:55.821941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f1c02eb0-721b-4051-b593-5c56e7683361 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.221528 Aug 02 10:18:55.822517 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 190/390] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:55 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:55.826013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:55.833523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c4ec15d7-c802-452d-a2a9-261a19ad8915 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.210459 Aug 02 10:18:55.834393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 201/391] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:55 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:56.027181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:56.027820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:56.034502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.034965 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.035730 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.036173 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.039498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:56.040106 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:56.046100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.046553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.047318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.048303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.228900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:56.237052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-12c4f8aa-4a2a-4d60-a7b6-d442bbd9b67f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.213757 Aug 02 10:18:56.237615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 191/392] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:56 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:56.243301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:56.251664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7484a3e4-f78a-4806-aa3a-5a554a76801f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.215844 Aug 02 10:18:56.252128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 202/393] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:56 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:56.844776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:56.849700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:56.855676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.856393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.857762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.858798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.860602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:56.861726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:56.870895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.871713 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:56.872970 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:56.873689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:57.087393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:57.091747 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:57.095398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-dc62435c-d21c-4cb4-9970-034ce08687df tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.255948 Aug 02 10:18:57.095910 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 192/394] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:56 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:57.099642 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c7caf1af-1f2a-4f01-b6f5-d2ebbbdc2fb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.247552 Aug 02 10:18:57.100283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 203/395] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:56 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:57.257537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:57.258175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:57.264303 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:57.264749 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:57.265505 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:57.266000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:57.272447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:57.273074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:57.279064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:57.279519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:57.280292 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:57.280733 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:57.470790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:57.474802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:57.478680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ccc91910-2b94-44ec-91cc-cd30541edfed tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.224976 Aug 02 10:18:57.479285 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 193/396] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:57 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:57.482911 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8dec448c-2a0f-4830-abfe-630bcbd684e2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.214348 Aug 02 10:18:57.483566 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 204/397] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:57 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:58.116020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:58.116745 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:58.120218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:58.120834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:58.123256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.123706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.124465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.124898 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.127214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.127661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.128428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.128855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.329832 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:58.332991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:58.337373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-090116cb-85c8-4564-ad6f-30cc73f353d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.225239 Aug 02 10:18:58.337966 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 194/398] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:58 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:58.340638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-13b51540-903e-44ec-92bd-6f74e031e1ed tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.224266 Aug 02 10:18:58.341191 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 205/399] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:58 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:58.501944 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:58.502569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:58.503792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:58.504412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:58.508545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.508992 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.509769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.510251 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.510474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.510890 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.511645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:58.512073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:58.707385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:58.711010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:58.715140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-42e623a4-aec3-47eb-ba63-86799cd046b3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.215043 Aug 02 10:18:58.715922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 206/400] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:58 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:58.723638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b35fe54f-fb86-446d-8a45-1f32013ce5f1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.221963 Aug 02 10:18:58.723638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 195/401] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:58 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:59.358810 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:59.359986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:59.362040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:59.362664 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:59.366064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.366519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.367292 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.367734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.369158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.369610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.370509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.370938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.384024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:59.577469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:59.580703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:59.585315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1e50aff6-bd7a-45cd-adbc-44302b9cffa8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.230432 Aug 02 10:18:59.585990 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 207/402] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:59 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:18:59.588246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f1025c61-8849-4522-a6f9-f8fd67f3f768 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.230536 Aug 02 10:18:59.589056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 196/403] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:59 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:59.738132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:59.738741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:59.740430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:18:59.741045 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:18:59.745970 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.746453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.747193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.747300 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.747633 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.747739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.748388 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:18:59.748816 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:18:59.952804 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:59.956966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:18:59.960445 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5d23b86c-ab92-4dd0-a3a5-2aecd79a98be tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.223711 Aug 02 10:18:59.961016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 197/404] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:59 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:18:59.964459 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-93750270-5997-4795-8495-5e30a00f5759 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.231497 Aug 02 10:18:59.965011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 208/405] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:18:59 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:00.607624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:00.608159 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:00.611563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:00.612182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:00.615379 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.615915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.616802 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.617313 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.618126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.618587 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.619354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.619799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.828400 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:00.835619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:00.841590 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-40a0f8a3-fa54-4fb7-850f-6c95f6c186a5 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.234561 Aug 02 10:19:00.842469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 209/406] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:00 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:00.846876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5b65ecfb-07b1-4f54-a03c-e6dc5636e97c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.243084 Aug 02 10:19:00.847598 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 198/407] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:00 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:00.980891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:00.981504 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:00.985003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:00.985697 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:00.987620 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.988061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.988852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.989282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.991872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.992322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:00.993081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:00.993520 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:01.186864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:01.190287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:01.195078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6127bdf0-a43a-4579-bcf4-4d77ee3cf9eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.214022 Aug 02 10:19:01.195645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 199/408] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:00 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:01.198040 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-dea4d802-f59a-4fc5-b6ab-6d18de3155fc tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.221014 Aug 02 10:19:01.198589 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 210/409] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:00 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:01.864428 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:01.865049 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:01.866637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:01.867152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:01.872352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:01.872814 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:01.873447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:01.873644 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:01.874014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:01.874124 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:01.880565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:01.881020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.073611 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:02.078095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:02.081453 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d97bcfed-24a8-448c-968b-01503bb05c79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.220816 Aug 02 10:19:02.082134 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 200/410] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:01 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:02.085450 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-074910b2-d7c9-4f3f-9ffc-89331aa54fee tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.222776 Aug 02 10:19:02.086037 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 211/411] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:01 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:02.217005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:02.217704 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:02.219795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:02.220445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:02.224310 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:02.224762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.226347 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:02.226544 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:02.226796 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.226991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.227874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:02.228180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:02.433228 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:02.436707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:02.441125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-46cfc30f-286f-4c7d-a931-4f238ad90d1c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.228183 Aug 02 10:19:02.441698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 201/412] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:02 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:02.444449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8dfc10f3-dfec-4219-913a-34ca3b849fc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.229093 Aug 02 10:19:02.445017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 212/413] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:02 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:03.103244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:03.103851 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:03.106417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:03.107104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:03.113624 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.114201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.115030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.115528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.119804 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.121542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.121542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.121542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.146265 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:03.329833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:03.334013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:03.337416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1df2cb85-5e89-4dcb-86c6-28c0e92ba489 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.234979 Aug 02 10:19:03.338020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 213/414] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:03 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:03.341871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-95775065-587c-4e14-9105-1817c28f415e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.242583 Aug 02 10:19:03.342584 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 202/415] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:03 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:03.463226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:03.463881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:03.465213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:03.465863 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:03.470392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.470849 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.471658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.472098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.472206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.472627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.473453 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:03.473910 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:03.670259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:03.675011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:03.678515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a8188cc2-c52a-43ad-aa4e-2489ddf9c820 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.219393 Aug 02 10:19:03.679094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 214/416] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:03 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:03.682431 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-96591cfc-5e8a-41d9-9d54-3aa469be30ac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.220937 Aug 02 10:19:03.683266 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 203/417] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:03 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:04.358786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:04.360611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:04.363489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:04.364605 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:04.369267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.370115 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.371087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.371532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.371679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.372237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.375682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.376380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.591338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:04.599038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:04.600122 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8cb65fcd-2bb7-4bf7-95a2-963f105e322d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.245229 Aug 02 10:19:04.600691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 215/418] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:04 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:04.606885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-051e0c12-dac2-4e06-8924-20a976ca32cb tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.248100 Aug 02 10:19:04.607455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 204/419] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:04 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:04.699364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:04.699975 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:04.704885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:04.705856 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:04.706779 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.707226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.708085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.708633 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.715816 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.716268 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.717049 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:04.717490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:04.917099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:04.920506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:04.925610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e4e4c27c-5d8e-4abe-9d1a-6b6df3918dc1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.230218 Aug 02 10:19:04.926225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 216/420] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:04 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:04.929022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-067655f2-d587-416b-8ad1-099d64e54f3f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.230117 Aug 02 10:19:04.929683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 205/421] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:04 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:05.622638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:05.623266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:05.630786 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:05.631485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:05.632078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:05.632979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:05.633244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:05.633864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:05.644059 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:05.648189 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:05.648679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:05.649198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:06.048471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:06.056528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0ae5011b-0cb5-4ef0-ad10-98c889cb8764 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.438017 Aug 02 10:19:06.058219 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 217/422] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:05 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:06.063330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:06.063958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:06.070433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:06.070433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:06.071182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:06.071945 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:06.115765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:06.128486 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-46a734d4-ff3b-46aa-800a-92548de70999 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.500449 Aug 02 10:19:06.129394 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 206/423] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:05 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:06.149073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:06.150117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:06.156028 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:06.156509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:06.157286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:06.157726 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:06.356103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:06.363720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8ca6d470-2f7c-44be-9977-55f870f66057 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.304719 Aug 02 10:19:06.364382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 218/424] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:06 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:06.376832 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:06.384309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-451457ab-b175-4728-af90-c544f000a4bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.243634 Aug 02 10:19:06.384864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 207/425] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:06 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:07.081010 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:07.081539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:07.087502 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.087971 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.088724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.089164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.153922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:07.155215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:07.162791 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.163244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.164032 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.164518 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.275540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:07.283280 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1cee200b-f47a-482e-8a44-6019c46962e0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.206844 Aug 02 10:19:07.283846 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 219/426] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:07 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:07.319590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:07.327307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d433053b-5241-43ce-a922-9239ec833e6a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.177197 Aug 02 10:19:07.327872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 208/427] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:07 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:07.384461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:07.385002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:07.391598 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.392050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.392821 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.393263 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.404358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:07.404977 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:07.410907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.411355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.412117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:07.412550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:07.594426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:07.598465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:07.601951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-eb4fa653-3710-4bf4-a0be-2eaa3569e58a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.221374 Aug 02 10:19:07.602525 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 220/428] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:07 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:07.605955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7fd414df-4f1a-4748-92a4-918a42102fad tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.205373 Aug 02 10:19:07.606512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 209/429] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:07 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:08.304317 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:08.305568 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:08.312632 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.313086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.313883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.314526 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.349705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:08.350638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:08.357733 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.358289 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.359288 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.359783 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.759185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:08.767407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5f39ff82-e236-44e8-96cf-d4ba51c355c5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.466922 Aug 02 10:19:08.768016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 221/430] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:08 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:08.772416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:08.773034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:08.775691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:08.780009 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.780462 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.781244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.781679 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.795210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:08.802706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-97f30e9d-1c08-4de4-a812-93f37279847b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.457223 Aug 02 10:19:08.803275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 210/431] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:08 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:08.808037 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:08.808661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:08.815021 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.816394 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.817222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:08.817668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:08.976955 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:08.984632 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6d0fafb5-58e7-4c18-94a8-7d1075435f7b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.215607 Aug 02 10:19:08.985207 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 222/432] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:08 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:09.011477 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:09.019675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9d2d31dc-e462-402e-b224-7fe1ad97afc7 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1358 microversion: 2.1 time: 0.215434 Aug 02 10:19:09.020244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 211/433] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:08 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:09.114339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-6303edca-3ce0-4cba-bdb1-ad8533955dfe req-11a4af4d-f8c5-4591-9b39-428a90c0c794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2038be26-c80e-4a20-9e1a-7d1e934fc85a", "name": "network-vif-plugged", "status": "completed", "tag": "becba994-ae6a-4325-bb4d-34342b50eadc"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:09.127314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-6303edca-3ce0-4cba-bdb1-ad8533955dfe req-11a4af4d-f8c5-4591-9b39-428a90c0c794 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:09.127768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-6303edca-3ce0-4cba-bdb1-ad8533955dfe req-11a4af4d-f8c5-4591-9b39-428a90c0c794 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:09.138986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-6303edca-3ce0-4cba-bdb1-ad8533955dfe req-11a4af4d-f8c5-4591-9b39-428a90c0c794 service nova] Creating event network-vif-plugged:becba994-ae6a-4325-bb4d-34342b50eadc for instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a on hv-cinder-84713 Aug 02 10:19:09.144291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-6303edca-3ce0-4cba-bdb1-ad8533955dfe req-11a4af4d-f8c5-4591-9b39-428a90c0c794 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Aug 02 10:19:09.144893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 223/434] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:09.788557 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:09.789173 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:09.795790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:09.796237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:09.797064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:09.798042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:09.824723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:09.825451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:09.832289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:09.832744 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:09.833513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:09.833985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:09.996717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.005697 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-27f49245-3b35-4c20-8982-125c150cb75f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.220869 Aug 02 10:19:10.006545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 212/435] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:09 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:10.011084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:10.011692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:10.019419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.019878 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.020717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.021495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.054478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.061540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:10.064668 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e6bcf020-2c64-498a-a372-0f70bd436028 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.244031 Aug 02 10:19:10.065332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 224/436] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:09 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:10.084039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:10.084944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:10.092001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.092457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.093320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.093767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.238068 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.246321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5f9f2d24-f351-4fef-a502-dea7243e10c5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.238581 Aug 02 10:19:10.246820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 213/437] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:10 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:10.278222 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.285651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5cea861d-fcb5-4247-b2b0-e01fc655432a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1548 microversion: 2.1 time: 0.205781 Aug 02 10:19:10.286245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 225/438] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:10 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:10.305931 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:10.306554 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:10.313461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.314114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.314767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.315214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.444402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.451778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f8b6e401-b42d-4e5a-a643-241216479f33 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1548 microversion: 2.1 time: 0.149785 Aug 02 10:19:10.452347 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 214/439] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:10 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:10.472265 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:10.477139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.477947 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Searching by: {'deleted': False, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4'} {{(pid=118032) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 10:19:10.484798 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.485335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.486168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.486604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.579452 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.multi_cell_list [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 10:19:10.675454 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2129cf48-d30a-40a9-816b-eb190a1b7ef3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206946 Aug 02 10:19:10.676037 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 226/440] 10.222.0.82 () {58 vars in 1125 bytes} [Tue Aug 2 10:19:10 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:10.690014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:10.690635 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:10.697873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.698325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.699099 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:10.699532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:10.958442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:10.969842 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9eff138d-2821-4882-bc1a-9c908cd0d2c1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1548 microversion: 2.1 time: 0.285028 Aug 02 10:19:10.970614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 215/441] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:10 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:11.027377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:11.027997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:11.035334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:11.035800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:11.036577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:11.037013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:11.087374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:11.088379 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:11.099675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:11.100111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:11.100892 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:11.101321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:11.249562 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:11.263295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7b2ddc47-8eb5-4a5b-bd11-140aba12834f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.239683 Aug 02 10:19:11.266169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 227/442] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:11 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:11.273071 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:11.274257 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:11.283542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:11.285711 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:11.286245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:11.287021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:11.287517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:11.291705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-452719d4-1578-45ec-9936-f42adf4745fe tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.209805 Aug 02 10:19:11.295743 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 216/443] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:11 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:11.424808 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:11.432720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-20e1c25a-1719-4cde-826b-049dd69ab455 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.165260 Aug 02 10:19:11.433639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 228/444] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:11 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:12.285769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:12.286417 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:12.292869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:12.293317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:12.294120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:12.294559 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:12.313604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:12.314290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:12.320315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:12.320751 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:12.321505 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:12.321962 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:12.488182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:12.495613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6320b8b8-adf0-4726-a5da-7db2c4d4a3f2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.213708 Aug 02 10:19:12.496190 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 217/445] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:12 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:12.502004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:12.502636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:12.509457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:12.510298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:12.511108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:12.511555 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:12.511700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:12.520630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9cd46d6c-3cb1-4971-b450-4a1df0742f0f tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.211346 Aug 02 10:19:12.521308 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 229/446] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:12 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:12.645059 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:12.648787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:12.654031 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cee5e2f4-9439-435e-80ef-ef92d3ed087b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.156851 Aug 02 10:19:12.654590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 218/447] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:12 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:13.516757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:13.517371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:13.523520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.523970 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.524734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.525168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.543318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:13.544069 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:13.546428 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=98 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:13.552256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.552712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.553487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.553955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.727407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:13.736068 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ea6824ee-2d1f-454f-974f-a5eb621e9e35 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.222450 Aug 02 10:19:13.736261 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:13.736379 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 230/448] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:13 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:13.741157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7ac831b-bf35-4631-89f6-ed1822ed3707"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:13.743603 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:13.744120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-96582112-ebe7-4b33-977c-a9390d2b3544 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1313 microversion: 2.1 time: 0.205047 Aug 02 10:19:13.744680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 219/449] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:13 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:13.749718 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.750281 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.751047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.751475 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.752219 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:13.752825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:13.758748 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.759196 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.759982 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:13.760414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:13.897990 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:13.905471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e514396f-6952-4c98-ba95-3cff6508408b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.159609 Aug 02 10:19:13.906087 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 220/450] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:13 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:14.757167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:14.757889 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:14.764958 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:14.765410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:14.766262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:14.766696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:14.902288 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:14.909615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-13475efc-248a-4320-a44d-56156750fcc7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.157035 Aug 02 10:19:14.910218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 221/451] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:14 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:14.914653 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:14.915258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:14.920822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:14.921280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:14.922672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:14.923115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.059669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:15.067663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cb6d75b0-70c6-4097-aeb7-173f77ef4616 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1496 microversion: 2.1 time: 0.156465 Aug 02 10:19:15.068280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 222/452] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:14 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:15.072572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:15.073173 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:15.078666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.079114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.079874 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.080308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.213754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:15.222484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-32d468ec-706f-472f-b967-f392ef892210 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.153233 Aug 02 10:19:15.223094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 223/453] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:15 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:15.619659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:15.620154 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:15.626498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.626949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.628181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.628621 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.660322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:19:15.751545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d6050beb-e5ef-4d3e-960d-5e5c702d3963 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "DELETE /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 204 len: 0 microversion: 2.1 time: 0.134729 Aug 02 10:19:15.752373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 224/454] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:19:15 2022] DELETE /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:19:15.762219 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:15.762805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:15.769181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.769631 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.770435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.770874 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.795296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e795128a-63ee-42dc-b2a8-b12fe1266078 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.057730 Aug 02 10:19:15.796386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 231/455] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:19:13 2022] POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments => generated 194 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:15.931298 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:15.932162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:15.940579 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.941203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.942389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:15.942831 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:15.971710 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:15.979583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c50b8493-e45c-43fa-934c-371c9f9695d7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1502 microversion: 2.1 time: 0.222280 Aug 02 10:19:15.980483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 225/456] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:15 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:16.084806 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:16.094680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a312ae46-52ff-4b9a-a36b-6ec5e02ccfab tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.167331 Aug 02 10:19:16.095257 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 232/457] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:15 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:16.246314 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:16.246909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:16.252886 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:16.253339 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:16.254140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:16.254582 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:16.388295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:16.396243 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f1ecd1d1-3754-4522-bbad-b8d607522086 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.154348 Aug 02 10:19:16.396804 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 226/458] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:16 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:17.001588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:17.002210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:17.008611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:17.009061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:17.009847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:17.010283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:17.116086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:17.116620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:17.122987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:17.123438 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:17.124210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:17.124643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:17.140136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:17.148030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b047d6de-88a1-41d2-9bd0-b69d57ca67fc tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1502 microversion: 2.1 time: 0.150808 Aug 02 10:19:17.148596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 233/459] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:16 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:17.264257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:17.272310 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4d9da45d-f791-4e03-8712-17260bb78aa9 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.160287 Aug 02 10:19:17.272879 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 227/460] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:17 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:17.417396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:17.418076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:17.424112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:17.424561 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:17.425332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:17.425764 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:17.555379 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:17.563214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c5427823-805f-41bf-a483-94a279ac8308 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.149669 Aug 02 10:19:17.563784 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 234/461] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:17 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:18.170390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:18.171007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:18.177561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:18.178064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:18.178831 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:18.179271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:18.293496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:18.294151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:18.300236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:18.300693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:18.301471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:18.302079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:18.314308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:18.322419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1e07ae84-c920-48e6-af84-5062562e2269 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1502 microversion: 2.1 time: 0.156013 Aug 02 10:19:18.323001 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 228/462] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:18 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:18.448638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:18.456735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f0787f06-cd18-48c0-8926-0c1e49c97f86 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.167067 Aug 02 10:19:18.457297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 235/463] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:18 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:18.584263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:18.584866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:18.591025 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:18.591469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:18.592221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:18.592679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:18.722808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:18.730395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d211d47b-0763-4896-aa36-02fd6f1f0f9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.149914 Aug 02 10:19:18.731322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 229/464] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:18 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:19.349273 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:19.349912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:19.356511 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:19.356958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:19.357728 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:19.358194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:19.478408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:19.479235 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:19.486640 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:19.487094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:19.487874 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:19.488474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:19.493818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:19.502386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-16d61062-3488-46dd-87ca-158987587c17 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1502 microversion: 2.1 time: 0.156939 Aug 02 10:19:19.510891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 236/465] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:19 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:19.629571 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:19.638247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ccad40f6-e7ca-4550-a514-df26cd803e11 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.163668 Aug 02 10:19:19.650728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 230/466] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:19 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:19.752933 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:19.753547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:19.759688 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:19.760140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:19.760900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:19.761333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:19.894325 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:19.901970 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d7cee02f-47a4-4915-bd01-2757d7c48882 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.153376 Aug 02 10:19:19.902467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 237/467] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:19 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:20.523508 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:20.524102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:20.530655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:20.531108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:20.532448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:20.532883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:20.660750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:20.661250 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:20.661564 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:20.667952 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:20.669409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-60ef95a3-376f-4c99-ab9f-a893aebcb882 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1502 microversion: 2.1 time: 0.149701 Aug 02 10:19:20.669877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:20.670115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 231/468] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:20 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:20.670703 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:20.671546 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:20.672185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:20.818769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:20.828332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-044d42a3-ae18-4220-a9b5-8329a89b6ea5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.172271 Aug 02 10:19:20.830070 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 238/469] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:20 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:20.923156 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:20.923793 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:20.930014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:20.930387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:20.931153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:20.931583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.137458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:21.148940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-86ffacea-7fbb-4d3d-83ee-bff245c3ef05 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1501 microversion: 2.1 time: 0.229220 Aug 02 10:19:21.150315 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 232/470] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:20 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:21.174969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d060b78-f8e8-42a8-a8ae-a373b904f45c"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:21.177673 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:21.191562 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.194969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.195951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.196661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.238145 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] HTTP exception thrown: Cannot 'attach_volume' instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad while it is in vm_state rescued Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Request method failure captured: Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/os-volume_attachments HTTP/1.1 Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 74 Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pl4Qg1fbk9Q6IAsiK-ICxPZDVrBX6kKakLaVCeFR-scn_fbQVbGC5H32XflrLKH87qeIrK06nIQHk0iVUimbUtWefirW2sFWljIyaikE_p_cmgtmUBhBBj6UJFmUliiqeqUpiPP3aJgPEDeN3B-Y3rZZqLcei4TANZJOZEOh14-dFc Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:19:21.240136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_ce6b9eda623740608e0c9998aaa74dab", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 99616b362eac4b7dba445dafd3ca1426 Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {"volumeAttachment": {"volumeId": "4d060b78-f8e8-42a8-a8ae-a373b904f45c"}} Aug 02 10:19:21.241597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Cannot 'attach_volume' instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad while it is in vm_state rescued Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'server_id': '1df5b287-bdb5-44e4-bbca-22bf77e34aad', 'body': {'volumeAttachment': {'volumeId': '4d060b78-f8e8-42a8-a8ae-a373b904f45c'}}} Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:19:21.242651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad while it is in vm_state rescued Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:19:21.244025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:19:21.245532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:19:21.245532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:19:21.245532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad while it is in vm_state rescued Aug 02 10:19:21.245532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:21.247114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Returning 409 to user: Cannot 'attach_volume' instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad while it is in vm_state rescued {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:19:21.248303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-13413964-85a5-4c4d-b66b-b33a55b077a7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077462 Aug 02 10:19:21.262218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 239/471] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:19:21 2022] POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 10:19:21.276400 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:21.277163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:21.286544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.287013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.287819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.288361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.350487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:21.388599 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-410ca27f-2016-46e3-89b9-0aa3db8edd0e req-fa2546ef-8d2c-496f-88e2-7487bc102915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2038be26-c80e-4a20-9e1a-7d1e934fc85a", "name": "network-vif-deleted", "tag": "becba994-ae6a-4325-bb4d-34342b50eadc"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:21.400730 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-410ca27f-2016-46e3-89b9-0aa3db8edd0e req-fa2546ef-8d2c-496f-88e2-7487bc102915 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.401290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-410ca27f-2016-46e3-89b9-0aa3db8edd0e req-fa2546ef-8d2c-496f-88e2-7487bc102915 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.406127 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:21.419776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-410ca27f-2016-46e3-89b9-0aa3db8edd0e req-fa2546ef-8d2c-496f-88e2-7487bc102915 service nova] Creating event network-vif-deleted:becba994-ae6a-4325-bb4d-34342b50eadc for instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a on hv-cinder-84713 Aug 02 10:19:21.427522 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-410ca27f-2016-46e3-89b9-0aa3db8edd0e req-fa2546ef-8d2c-496f-88e2-7487bc102915 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042943 Aug 02 10:19:21.432221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 240/472] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:19:21.437089 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1b475072-b949-48fc-a40e-524e05fb6a62 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/action" status: 202 len: 0 microversion: 2.1 time: 0.166754 Aug 02 10:19:21.438820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 233/473] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:19:21 2022] POST /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:19:21.447505 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:21.448442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:21.456704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.457159 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.458118 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.458611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.500355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-5fc8b10f-380a-4cba-ad2f-5fec6fb6d74c req-ec297bc3-f338-4d6a-b821-dfc0733a521b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "name": "network-vif-plugged", "status": "completed", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:21.528844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-5fc8b10f-380a-4cba-ad2f-5fec6fb6d74c req-ec297bc3-f338-4d6a-b821-dfc0733a521b service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.529596 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-5fc8b10f-380a-4cba-ad2f-5fec6fb6d74c req-ec297bc3-f338-4d6a-b821-dfc0733a521b service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.556554 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-5fc8b10f-380a-4cba-ad2f-5fec6fb6d74c req-ec297bc3-f338-4d6a-b821-dfc0733a521b service nova] Creating event network-vif-plugged:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:19:21.583399 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-5fc8b10f-380a-4cba-ad2f-5fec6fb6d74c req-ec297bc3-f338-4d6a-b821-dfc0733a521b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085869 Aug 02 10:19:21.587882 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 234/474] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:21.638557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:21.646417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-71be4776-4415-4974-a31a-7b78314d60b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1509 microversion: 2.1 time: 0.203364 Aug 02 10:19:21.646984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 241/475] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:21 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:21.693408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:21.694359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:21.702736 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.703591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.704655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.705572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.742720 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.743174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.743636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lazy-loading 'fault' on Instance uuid 2038be26-c80e-4a20-9e1a-7d1e934fc85a {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:19:21.794276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:21.805643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-46b7a735-88b5-4ac4-a7ce-9959462e6e5c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 200 len: 1303 microversion: 2.1 time: 0.117279 Aug 02 10:19:21.815184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 235/476] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:21 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:21.850891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:21.852634 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:21.868563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.869047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:21.869899 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:21.870349 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:22.023228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:22.030830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2c069d26-aa04-495b-8c53-001551fda43f tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.184871 Aug 02 10:19:22.031390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 242/477] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:21 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:22.668323 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:22.668921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:22.675432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:22.675884 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:22.676651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:22.677080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:22.808383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:22.816601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f8139f9e-3e7a-441e-81b5-e75bda49ab45 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1509 microversion: 2.1 time: 0.152250 Aug 02 10:19:22.817185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 236/478] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:22 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:22.832001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:22.832612 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 2038be26-c80e-4a20-9e1a-7d1e934fc85a] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:22.838785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:22.839235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:22.840075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:22.840432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:22.854056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] HTTP exception thrown: Instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a could not be found. Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Request method failure captured: Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a HTTP/1.1 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PnjeTCbpl-oXC2R9feWgUZ67GhYJuYKBjCSRevJELVUFrGFsrLdoi0ebmcblRpc7bkXJfm4B3oETof87wMxiHzVgVozWxspf8D26QPScHm86tAbmSaeIDeHYD2hN3C_Gk1LdAbV9s3xfUK_9ujhdARjS3h0I-18mAkNXNvUpX-mGV8 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: b83d3a9d900c4e9383fa88fd1475c029 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesActionsTest-628740404 Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:19:22.855694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b83d3a9d900c4e9383fa88fd1475c029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b83d3a9d900c4e9383fa88fd1475c029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b83d3a9d900c4e9383fa88fd1475c029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b83d3a9d900c4e9383fa88fd1475c029", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesActionsTest-628740404 Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: b83d3a9d900c4e9383fa88fd1475c029 Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesActionsTest-628740404 Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesActionsTest-628740404-project Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: a5f2ec904f214a708a3691da24fb516d Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesActionsTest-628740404-project Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a could not be found. Aug 02 10:19:22.857252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '2038be26-c80e-4a20-9e1a-7d1e934fc85a'} Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a could not be found. Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:19:22.858941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a could not be found. Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a could not be found. Aug 02 10:19:22.860351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:22.861638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Returning 404 to user: Instance 2038be26-c80e-4a20-9e1a-7d1e934fc85a could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:19:22.861638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5cdaec57-7bb4-416f-9ee9-56b93933bdf4 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a" status: 404 len: 111 microversion: 2.1 time: 0.029535 Aug 02 10:19:22.861638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 243/479] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:22 2022] GET /compute/v2.1/servers/2038be26-c80e-4a20-9e1a-7d1e934fc85a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:19:22.969262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2049760532", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "networks": [{"uuid": "1967c145-b8f4-4815-a5fd-b82cd154be4a"}]}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:23.021375 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] validate_networks() for [('1967c145-b8f4-4815-a5fd-b82cd154be4a', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:19:23.052217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:23.052874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:23.059784 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:23.060238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:23.061015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:23.061476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:23.254447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:23.262204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-fc3c6161-ce63-49d6-ab72-065f58c805e7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1260 microversion: 2.1 time: 0.214603 Aug 02 10:19:23.262857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 244/480] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:23 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:23.437703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:19:23.438705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:19:23.439183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:19:23.439593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:19:23.440005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:19:23.451180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:23.451622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:23.452422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:23.452968 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:23.471563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Getting quotas for project b83d3a9d900c4e9383fa88fd1475c029. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:19:23.475466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Getting quotas for user a5f2ec904f214a708a3691da24fb516d and project b83d3a9d900c4e9383fa88fd1475c029. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:19:23.486123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:19:23.488364 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:19:23.536102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-31f55acf-d00d-4c82-8553-32ec02711eef tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570600 Aug 02 10:19:23.536661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 237/481] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:19:23.547466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f84f72c1-0deb-4438-8bf3-1063b3578508 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:23.548078 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f84f72c1-0deb-4438-8bf3-1063b3578508 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:23.605800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f84f72c1-0deb-4438-8bf3-1063b3578508 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:23.614766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f84f72c1-0deb-4438-8bf3-1063b3578508 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1214 microversion: 2.1 time: 0.071031 Aug 02 10:19:23.615349 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 245/482] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:23 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:23.839907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:23.840687 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:23.855810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:23.856274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:23.857062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:23.857497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:23.994090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:24.002450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e3ae933f-a9ba-477b-bded-1bfdb16ecebb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1509 microversion: 2.1 time: 0.166953 Aug 02 10:19:24.003017 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 238/483] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:23 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:24.283301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:24.283940 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:24.290531 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:24.290982 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:24.292107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:24.292614 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:24.427904 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:24.436122 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f13368ac-7cb4-45c5-a6f5-a860eb0deb47 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1444 microversion: 2.1 time: 0.156894 Aug 02 10:19:24.436678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 246/484] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:24 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:24.457050 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:24.457664 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:24.463617 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:24.464152 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:24.464901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:24.465335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:24.601276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:24.608730 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-862602bf-769f-497f-924e-9944353d6b99 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1444 microversion: 2.1 time: 0.156085 Aug 02 10:19:24.609280 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 239/485] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:24 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:24.635848 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:24.636392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:24.643237 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:24.643682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:24.644482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:24.644917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:24.710218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:24.717608 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e01d1ee7-d580-468e-8ceb-33c8d3e0b401 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1210 microversion: 2.1 time: 0.085639 Aug 02 10:19:24.718471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 247/486] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:24 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:25.023439 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:25.024056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:25.030487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:25.030949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:25.031726 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:25.032166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:25.169074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:25.177048 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fdfd0461-8a1a-406c-9e6e-b02481005301 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1509 microversion: 2.1 time: 0.157452 Aug 02 10:19:25.177724 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 240/487] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:25 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:25.740107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:25.740829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:25.747324 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:25.747775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:25.748555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:25.749038 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:25.812052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:25.819839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-24942f4b-57b8-4997-b8e1-4b180a302e43 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1210 microversion: 2.1 time: 0.084367 Aug 02 10:19:25.820417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 248/488] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:25 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:26.198972 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:26.199588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:26.206038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:26.206486 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:26.207245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:26.207672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:26.411193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-6399be8d-4fe0-4835-8e21-c02674d181b6 req-a2b0a884-b73d-4500-b4a2-9fa259f42688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:26.421025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-6399be8d-4fe0-4835-8e21-c02674d181b6 req-a2b0a884-b73d-4500-b4a2-9fa259f42688 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:26.421477 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-6399be8d-4fe0-4835-8e21-c02674d181b6 req-a2b0a884-b73d-4500-b4a2-9fa259f42688 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:26.435464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-6399be8d-4fe0-4835-8e21-c02674d181b6 req-a2b0a884-b73d-4500-b4a2-9fa259f42688 service nova] Creating event network-changed:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:19:26.441029 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-6399be8d-4fe0-4835-8e21-c02674d181b6 req-a2b0a884-b73d-4500-b4a2-9fa259f42688 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033458 Aug 02 10:19:26.443051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 249/489] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:19:26.598155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:26.605721 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d3789c89-a70b-48ac-8c65-8712033e3811 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1509 microversion: 2.1 time: 0.410764 Aug 02 10:19:26.606397 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 241/490] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:26 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:26.841691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:26.842334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:26.848851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:26.849410 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:26.850306 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:26.850842 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:26.912649 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:26.920072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-189ec88b-af57-48b7-9266-1d658be0bea2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1210 microversion: 2.1 time: 0.083255 Aug 02 10:19:26.920632 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 250/491] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:26 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:27.626257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:27.626897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:27.633344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:27.633807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:27.634601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:27.635043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:27.805514 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:27.813665 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-309a7e20-3f0b-41d1-8350-20adfd7aa64f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1509 microversion: 2.1 time: 0.191467 Aug 02 10:19:27.814254 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 242/492] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:27 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:27.942611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:27.943187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:27.949824 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:27.950284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:27.951049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:27.951488 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:28.013223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:28.021328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0d943c23-fcea-4f2b-88b6-c0773c8f9a77 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1266 microversion: 2.1 time: 0.083197 Aug 02 10:19:28.021927 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 251/493] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:27 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:28.835557 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:28.836150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:28.843542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:28.843998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:28.844769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:28.845211 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:28.982811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:28.991033 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d32b1131-74bf-40d2-83ad-eb0ad1fe4f47 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1515 microversion: 2.1 time: 0.159490 Aug 02 10:19:28.991593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 243/494] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:28 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:29.042130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:29.042740 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:29.049225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:29.049677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:29.050478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:29.050912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:29.120524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:29.127973 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f058be92-546d-493f-aa95-be9b331b2f79 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1266 microversion: 2.1 time: 0.089652 Aug 02 10:19:29.128533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 252/495] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:29 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:30.151425 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:30.152151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:30.162318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:30.163112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:30.164461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:30.165233 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:30.271904 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:30.279940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2b136774-f94e-49ef-a0e0-9ce9ecf29893 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1272 microversion: 2.1 time: 0.132399 Aug 02 10:19:30.280678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 244/496] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:30 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:30.381378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9af2cd45-ce97-4922-a7d1-9cebea3d6b0b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'create', calling method: .version_select at 0x7f5c080629d0>, body: {"keypair": {"name": "tempest-keypair-1522555255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/uRkPXtHPKB/7oNQBCFdPAZiXbXNusmYMHYqCfKRRbBWPPr2ktvdxnFzwrDY1fvsOwwD0zQKxJITwLsvxob3PO1KKQw0TiF7dzUMP6p6rTIqgTcvUfkdF0XgIL5FdkVw=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:30.402096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-9af2cd45-ce97-4922-a7d1-9cebea3d6b0b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for project ce6b9eda623740608e0c9998aaa74dab. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:19:30.408089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-9af2cd45-ce97-4922-a7d1-9cebea3d6b0b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for user 99616b362eac4b7dba445dafd3ca1426 and project ce6b9eda623740608e0c9998aaa74dab. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:19:30.431826 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9af2cd45-ce97-4922-a7d1-9cebea3d6b0b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056187 Aug 02 10:19:30.433515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 253/497] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:19:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:30.930779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:30.931482 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:30.938370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:30.938912 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:30.939762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:30.940204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:31.204633 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:31.212804 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a171c236-dc45-417d-9ddb-09632c99c2dd tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1594 microversion: 2.1 time: 0.286193 Aug 02 10:19:31.219433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 245/498] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:30 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1594 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:31.305120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:31.305827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:31.314032 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:31.314755 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:31.315551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:31.316152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:31.575078 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:31.584281 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2880f3b1-89d3-453c-a86f-3d9aa505392c tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.283774 Aug 02 10:19:31.599138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 254/499] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:31 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:32.104534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-94e8ab6c-112e-4800-9118-8d6ab0ca057f req-3741ef13-00df-425e-89d9-6d215abf6594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669a2c33-db1e-4179-82b4-f2574faacc3c", "tag": "62c29ed3-470f-460a-a2b1-e6e8bf731311"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:32.115446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-94e8ab6c-112e-4800-9118-8d6ab0ca057f req-3741ef13-00df-425e-89d9-6d215abf6594 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:32.116304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-94e8ab6c-112e-4800-9118-8d6ab0ca057f req-3741ef13-00df-425e-89d9-6d215abf6594 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:32.122241 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-999674256", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af65931f-804a-4097-ad31-d27fcf02711b"}], "security_groups": [{"name": "tempest-securitygroup--1343117951"}], "key_name": "tempest-keypair-1522555255", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:32.131299 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-94e8ab6c-112e-4800-9118-8d6ab0ca057f req-3741ef13-00df-425e-89d9-6d215abf6594 service nova] Creating event network-changed:62c29ed3-470f-460a-a2b1-e6e8bf731311 for instance 669a2c33-db1e-4179-82b4-f2574faacc3c on hv-cinder-84713 Aug 02 10:19:32.136799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-94e8ab6c-112e-4800-9118-8d6ab0ca057f req-3741ef13-00df-425e-89d9-6d215abf6594 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037689 Aug 02 10:19:32.137747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 246/500] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:19:32.376076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] validate_networks() for [('af65931f-804a-4097-ad31-d27fcf02711b', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:19:32.608404 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:32.609084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:32.615766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:32.616220 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:32.616999 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:32.617435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:33.103761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:33.111811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4870e742-5dec-47d3-af9d-9565974e63cd tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.508246 Aug 02 10:19:33.112467 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 247/501] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:32 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:33.583750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:19:33.584238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:19:33.584884 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:19:33.585366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:19:33.585820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:19:33.595303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:33.595753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:33.596556 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:33.596992 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:33.614331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for project ce6b9eda623740608e0c9998aaa74dab. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:19:33.618362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Getting quotas for user 99616b362eac4b7dba445dafd3ca1426 and project ce6b9eda623740608e0c9998aaa74dab. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:19:33.629534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:19:33.631841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:19:33.682435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e2b5e7e4-fbe0-4f4b-923d-656a637393bc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.565283 Aug 02 10:19:33.683093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 255/502] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:19:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:19:33.694317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fdba2b87-1aba-43b2-a931-50a89f635bf3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:33.695103 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-fdba2b87-1aba-43b2-a931-50a89f635bf3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:33.697193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:33.698002 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:33.764795 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-fdba2b87-1aba-43b2-a931-50a89f635bf3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:33.772972 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fdba2b87-1aba-43b2-a931-50a89f635bf3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1245 microversion: 2.1 time: 0.082410 Aug 02 10:19:33.773688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 248/503] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:33 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:34.134801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:34.135428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:34.142586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:34.143042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:34.143814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:34.144249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:34.351048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:34.358664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a75446a0-341a-429d-8139-4977a980751a tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.228646 Aug 02 10:19:34.359554 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 256/504] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:34 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:34.464115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-b16ab6c8-a5ce-4622-959a-f598c30b0238 req-c552dc6c-973d-4b94-8dc0-e3cb8d9abd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:34.475524 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-b16ab6c8-a5ce-4622-959a-f598c30b0238 req-c552dc6c-973d-4b94-8dc0-e3cb8d9abd10 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:34.476339 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-b16ab6c8-a5ce-4622-959a-f598c30b0238 req-c552dc6c-973d-4b94-8dc0-e3cb8d9abd10 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:34.489170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-b16ab6c8-a5ce-4622-959a-f598c30b0238 req-c552dc6c-973d-4b94-8dc0-e3cb8d9abd10 service nova] Creating event network-changed:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:19:34.494158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-b16ab6c8-a5ce-4622-959a-f598c30b0238 req-c552dc6c-973d-4b94-8dc0-e3cb8d9abd10 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034054 Aug 02 10:19:34.494833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 249/505] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:34.797371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:34.798767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:34.809598 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:34.810082 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:34.810862 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:34.811302 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:34.895339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:34.907440 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-acb3e9aa-08c2-47d0-aa01-03677b23abf8 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1249 microversion: 2.1 time: 0.114937 Aug 02 10:19:34.908698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 257/506] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:34 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:35.380365 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:35.381067 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:35.387797 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:35.388448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:35.389287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:35.389649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:35.604901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:35.613054 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ee0183ea-763d-4fad-ba55-460f29c1fb4b tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.237359 Aug 02 10:19:35.613861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 250/507] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:35 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:35.748870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-391170367"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:35.749410 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:35.751404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:35.757329 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:35.757797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:35.758596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:35.759026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:35.929040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:35.929760 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:35.936249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:35.936694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:35.937476 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:35.937941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:36.153812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:36.161180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2d589704-345a-42e7-9a51-23ac262f1d2a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1249 microversion: 2.1 time: 0.236099 Aug 02 10:19:36.161716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 251/508] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:35 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1249 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:36.161868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.network.security_group_api [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Adding security group 961d22f7-5439-4a1c-a409-e0a175acd4ba to port 64a78f08-466d-4e1d-8c12-e3c34f532e6c Aug 02 10:19:36.482985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c7c9c39c-2724-41a6-a3d4-82b2ae69fbac tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/action" status: 202 len: 0 microversion: 2.1 time: 0.738458 Aug 02 10:19:36.487644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 258/509] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:19:35 2022] POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:19:36.493125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:36.493738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:36.500457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:36.500894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:36.501886 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:36.502332 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:36.518433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-a4f60a8c-2017-43ec-a066-c571a95aa632 req-f122c274-e66a-4e35-85ef-f396f11c1a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:36.543326 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-a4f60a8c-2017-43ec-a066-c571a95aa632 req-f122c274-e66a-4e35-85ef-f396f11c1a3a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:36.543768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-a4f60a8c-2017-43ec-a066-c571a95aa632 req-f122c274-e66a-4e35-85ef-f396f11c1a3a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:36.555828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-a4f60a8c-2017-43ec-a066-c571a95aa632 req-f122c274-e66a-4e35-85ef-f396f11c1a3a service nova] Creating event network-changed:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:19:36.562205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-a4f60a8c-2017-43ec-a066-c571a95aa632 req-f122c274-e66a-4e35-85ef-f396f11c1a3a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051187 Aug 02 10:19:36.563249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 259/510] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:36.635355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:36.636346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:36.644313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:36.644773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:36.645738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:36.646358 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:36.661397 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:36.667852 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:36.676712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2bf7a27d-d3be-4d15-80b0-86bc6f205c8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1640 microversion: 2.1 time: 0.187871 Aug 02 10:19:36.680623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 252/511] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:36 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1640 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:37.000913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:37.009711 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4881e4c4-57a9-4cb6-a7e7-00d5bb80e660 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.378515 Aug 02 10:19:37.010723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 260/512] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:36 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:37.181666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:37.182337 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:37.189161 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:37.189607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:37.190412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:37.190839 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:37.254053 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:37.262013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7e23a0a9-471a-476d-9884-bf582700649c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1297 microversion: 2.1 time: 0.084505 Aug 02 10:19:37.262490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 253/513] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:37 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:38.031375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:38.032146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:38.038925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:38.039375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:38.040148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:38.040586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:38.283119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:38.283821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:38.290395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:38.290851 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:38.291629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:38.292077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:38.309655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:38.318636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7ba1150f-902d-4d85-ba8b-0b394cf509cf tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.291994 Aug 02 10:19:38.332628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 261/514] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:38 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:38.386774 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:38.394147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-58c91d53-4bfe-4089-9b4a-fd386fa8b5aa tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1303 microversion: 2.1 time: 0.114992 Aug 02 10:19:38.394708 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 254/515] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:38 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:39.339011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:39.339753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:39.346287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:39.346738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:39.347506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:39.347941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:39.362735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:39.416356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:39.417766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:39.425818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:39.426353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:39.427600 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:39.428126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:39.732344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:39.743795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c1686f0d-892a-4b2b-9c45-587e7857292d tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.408388 Aug 02 10:19:39.744596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 262/516] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:39 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:39.749753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-fee71f8c-769e-4875-b5d7-4b4798b152d4 req-f9af7585-dfe5-4b10-a493-27204812cb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669a2c33-db1e-4179-82b4-f2574faacc3c", "name": "network-vif-plugged", "status": "completed", "tag": "62c29ed3-470f-460a-a2b1-e6e8bf731311"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:39.760410 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-fee71f8c-769e-4875-b5d7-4b4798b152d4 req-f9af7585-dfe5-4b10-a493-27204812cb8c service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:39.760941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-fee71f8c-769e-4875-b5d7-4b4798b152d4 req-f9af7585-dfe5-4b10-a493-27204812cb8c service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:39.772675 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-fee71f8c-769e-4875-b5d7-4b4798b152d4 req-f9af7585-dfe5-4b10-a493-27204812cb8c service nova] Creating event network-vif-plugged:62c29ed3-470f-460a-a2b1-e6e8bf731311 for instance 669a2c33-db1e-4179-82b4-f2574faacc3c on hv-cinder-84713 Aug 02 10:19:39.777656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-fee71f8c-769e-4875-b5d7-4b4798b152d4 req-f9af7585-dfe5-4b10-a493-27204812cb8c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 Aug 02 10:19:39.778103 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:39.778585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 263/517] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:39.786447 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-91fb538e-bafa-4358-a2d3-9a01713da98c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.373996 Aug 02 10:19:39.787026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 255/518] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:39 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:40.192971 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-f2a7407e-1242-4f0b-b4a5-6d4cb8445f01 req-1a0b91db-37f7-4c7c-a3f0-4050c4e3b9ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d69ccee-5a6a-4991-9ef2-38f45d65faf2", "tag": "d7fdcba9-37a2-4374-96d7-ddbf45910b7a"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:40.205537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f2a7407e-1242-4f0b-b4a5-6d4cb8445f01 req-1a0b91db-37f7-4c7c-a3f0-4050c4e3b9ae service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:40.206011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f2a7407e-1242-4f0b-b4a5-6d4cb8445f01 req-1a0b91db-37f7-4c7c-a3f0-4050c4e3b9ae service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:40.219135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-f2a7407e-1242-4f0b-b4a5-6d4cb8445f01 req-1a0b91db-37f7-4c7c-a3f0-4050c4e3b9ae service nova] Creating event network-changed:d7fdcba9-37a2-4374-96d7-ddbf45910b7a for instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 on hv-cinder-84713 Aug 02 10:19:40.224231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-f2a7407e-1242-4f0b-b4a5-6d4cb8445f01 req-1a0b91db-37f7-4c7c-a3f0-4050c4e3b9ae service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035670 Aug 02 10:19:40.225347 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 264/519] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:40.765003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:40.765622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:40.772731 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:40.773183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:40.773999 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:40.774437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:40.809164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:40.810149 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:40.817131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:40.817665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:40.818495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:40.818957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:40.960409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:40.968601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4942bde0-9b89-4059-95e2-dc185c34d5d9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.207269 Aug 02 10:19:40.969500 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 256/520] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:40 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:40.984092 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:40.991932 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9ea4e368-0bc7-485f-8579-f9b3f094281c tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.187468 Aug 02 10:19:40.992495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 265/521] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:40 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:41.990256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:41.990922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:41.993180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:41.998469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:41.998913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:41.999670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:42.000102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:42.012451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:42.013058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:42.020087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:42.020540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:42.021313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:42.021753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:42.239519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:42.242423 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:42.247292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-754cefe1-41a4-4c2e-a44b-33a44cfb8e2e tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1314 microversion: 2.1 time: 0.260790 Aug 02 10:19:42.248055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 257/522] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:41 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:42.249877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6c60c4f0-a5a2-40ff-8569-04d3beae5ce6 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.241238 Aug 02 10:19:42.250427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 266/523] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:42 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:19:43.269259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:43.270016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:43.270816 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:43.271436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:43.275937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:43.276385 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:43.277151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:43.277583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:43.278073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:43.278531 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:43.279331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:43.279873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:43.474361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:43.477604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:43.481867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0dc0bd8b-104e-4f63-9580-144e16a70474 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1497 microversion: 2.1 time: 0.216981 Aug 02 10:19:43.482788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 258/524] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:43 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:43.485745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7edaa879-85b0-4300-a228-88e68c6025b9 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.218180 Aug 02 10:19:43.486335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 267/525] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:43 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:44.103791 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:44.104295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:44.106208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:44.111834 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:44.112354 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:44.113055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:44.113563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:44.138409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:19:44.211069 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f44fd6c9-0773-4f1f-8dc5-1b494f7ee547 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "DELETE /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 204 len: 0 microversion: 2.1 time: 0.110969 Aug 02 10:19:44.211642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 259/526] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:19:44 2022] DELETE /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:19:44.220244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:44.220855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:44.223000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:44.223644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=12 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:44.229275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:44.229718 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:44.230580 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:44.231012 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:44.359820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:44.367267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2ea5dc95-7bcf-49ce-8734-1e7c3a3251c2 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1503 microversion: 2.1 time: 0.151357 Aug 02 10:19:44.367833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 268/527] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:44 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:44.507675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:44.508376 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:44.514808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:44.515263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:44.516064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:44.517113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:44.649260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:44.656679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b81a7816-a2a1-4ece-aee9-dc42a0573fd1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.153222 Aug 02 10:19:44.657873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 260/528] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:44 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:45.388450 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:45.389067 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:45.396255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:45.396708 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:45.397480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:45.397949 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:45.530134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:45.538097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ef401665-fb3c-4012-8423-25d3cc3d6e49 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1503 microversion: 2.1 time: 0.153465 Aug 02 10:19:45.538663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 269/529] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:45 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:45.677220 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:45.677761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:45.684161 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:45.684868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:45.685625 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:45.686092 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:45.820742 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:45.828002 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a9c7747e-f65f-41df-b8df-6a3bccd5f507 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.154718 Aug 02 10:19:45.828570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 261/530] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:45 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:46.559431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:46.560344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:46.567467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:46.567931 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:46.568713 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:46.569150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:46.700628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:46.708086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2e24086f-fa6c-4795-a097-94f7c399a438 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1503 microversion: 2.1 time: 0.152688 Aug 02 10:19:46.708648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 270/531] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:46 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:46.849728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:46.850320 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:46.856823 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:46.857277 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:46.858079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:46.858512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:46.986360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:46.993581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c00a707e-7a88-4d7a-b788-34604237117e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.147758 Aug 02 10:19:46.994155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 262/532] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:46 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:47.729706 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:47.730540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:47.736985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:47.737428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:47.738209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:47.738646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:47.870833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:47.878312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f2205e7f-577e-44dd-a676-486e29c5fcb9 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1503 microversion: 2.1 time: 0.152606 Aug 02 10:19:47.878891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 271/533] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:47 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:48.014429 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:48.015047 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:48.022008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:48.022476 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:48.023229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:48.023666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:48.240172 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:48.247721 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b1e18505-8ee7-4f34-bb7e-a8c11200f872 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.237192 Aug 02 10:19:48.248292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 263/534] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:48 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:48.478586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-21a69a36-d5ae-4e0d-a89b-dc9c74f6d97f req-7d1a77e2-a739-4cad-8f3d-97f8b335dbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669a2c33-db1e-4179-82b4-f2574faacc3c", "name": "network-vif-deleted", "tag": "62c29ed3-470f-460a-a2b1-e6e8bf731311"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:48.488663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-21a69a36-d5ae-4e0d-a89b-dc9c74f6d97f req-7d1a77e2-a739-4cad-8f3d-97f8b335dbf9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:48.489107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-21a69a36-d5ae-4e0d-a89b-dc9c74f6d97f req-7d1a77e2-a739-4cad-8f3d-97f8b335dbf9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:48.501173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-21a69a36-d5ae-4e0d-a89b-dc9c74f6d97f req-7d1a77e2-a739-4cad-8f3d-97f8b335dbf9 service nova] Creating event network-vif-deleted:62c29ed3-470f-460a-a2b1-e6e8bf731311 for instance 669a2c33-db1e-4179-82b4-f2574faacc3c on hv-cinder-84713 Aug 02 10:19:48.506197 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-21a69a36-d5ae-4e0d-a89b-dc9c74f6d97f req-7d1a77e2-a739-4cad-8f3d-97f8b335dbf9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 Aug 02 10:19:48.506870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 272/535] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:48.899150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:48.899758 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:48.905748 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:48.906216 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:48.907034 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:48.907469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:48.936913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:48.937353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:48.937818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lazy-loading 'fault' on Instance uuid 669a2c33-db1e-4179-82b4-f2574faacc3c {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:19:48.978405 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f2ec904f214a708a3691da24fb516d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83d3a9d900c4e9383fa88fd1475c029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:48.985594 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e5d9de32-d8ad-4bd0-9360-54c18ed325f7 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 200 len: 1304 microversion: 2.1 time: 0.090250 Aug 02 10:19:48.986250 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 264/536] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:48 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:49.268865 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:49.269555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:49.276187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:49.276633 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:49.277392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:49.277901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:49.364599 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:49.365108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:49.371615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:49.372059 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:49.372823 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:49.373249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:49.397516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5f40bd6f-2a09-498c-b608-d3ff41feb744 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/ips" status: 200 len: 145 microversion: 2.1 time: 0.037289 Aug 02 10:19:49.398359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 265/537] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:19:49 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:19:49.414704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:49.422138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-05ed492a-b782-4400-9c3b-40eaf19135eb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.157352 Aug 02 10:19:49.423211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 273/538] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:49 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:49.936020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-4e3a4286-faa3-41a1-a8ea-45c3b5cf65d0 req-c694e684-f62c-4772-aa2b-4c25cb6d91f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d69ccee-5a6a-4991-9ef2-38f45d65faf2", "name": "network-vif-plugged", "status": "completed", "tag": "d7fdcba9-37a2-4374-96d7-ddbf45910b7a"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:49.945756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-4e3a4286-faa3-41a1-a8ea-45c3b5cf65d0 req-c694e684-f62c-4772-aa2b-4c25cb6d91f9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:49.946246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-4e3a4286-faa3-41a1-a8ea-45c3b5cf65d0 req-c694e684-f62c-4772-aa2b-4c25cb6d91f9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:49.957670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-4e3a4286-faa3-41a1-a8ea-45c3b5cf65d0 req-c694e684-f62c-4772-aa2b-4c25cb6d91f9 service nova] Creating event network-vif-plugged:d7fdcba9-37a2-4374-96d7-ddbf45910b7a for instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 on hv-cinder-84713 Aug 02 10:19:49.962550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-4e3a4286-faa3-41a1-a8ea-45c3b5cf65d0 req-c694e684-f62c-4772-aa2b-4c25cb6d91f9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030527 Aug 02 10:19:49.963134 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 266/539] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:19:50.018438 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:50.019448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] [instance: 669a2c33-db1e-4179-82b4-f2574faacc3c] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:50.026603 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:50.027051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:50.027823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:50.028264 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:50.043111 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] HTTP exception thrown: Instance 669a2c33-db1e-4179-82b4-f2574faacc3c could not be found. Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Request method failure captured: Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c HTTP/1.1 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PnjeTCbpl-oXC2R9feWgUZ67GhYJuYKBjCSRevJELVUFrGFsrLdoi0ebmcblRpc7bkXJfm4B3oETof87wMxiHzVgVozWxspf8D26QPScHm86tAbmSaeIDeHYD2hN3C_Gk1LdAbV9s3xfUK_9ujhdARjS3h0I-18mAkNXNvUpX-mGV8 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: b83d3a9d900c4e9383fa88fd1475c029 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesActionsTest-628740404 Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:19:50.044775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b83d3a9d900c4e9383fa88fd1475c029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b83d3a9d900c4e9383fa88fd1475c029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b83d3a9d900c4e9383fa88fd1475c029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b83d3a9d900c4e9383fa88fd1475c029", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesActionsTest-628740404 Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: b83d3a9d900c4e9383fa88fd1475c029 Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesActionsTest-628740404 Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesActionsTest-628740404-project Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: a5f2ec904f214a708a3691da24fb516d Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesActionsTest-628740404-project Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 669a2c33-db1e-4179-82b4-f2574faacc3c could not be found. Aug 02 10:19:50.046485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '669a2c33-db1e-4179-82b4-f2574faacc3c'} Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669a2c33-db1e-4179-82b4-f2574faacc3c could not be found. Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:19:50.047369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669a2c33-db1e-4179-82b4-f2574faacc3c could not be found. Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669a2c33-db1e-4179-82b4-f2574faacc3c could not be found. Aug 02 10:19:50.048841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:19:50.050492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] Returning 404 to user: Instance 669a2c33-db1e-4179-82b4-f2574faacc3c could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:19:50.050492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f2703410-3bf7-46d8-bf58-dd829727b422 tempest-VolumesActionsTest-628740404 tempest-VolumesActionsTest-628740404-project] 10.222.0.82 "GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c" status: 404 len: 111 microversion: 2.1 time: 0.042870 Aug 02 10:19:50.050492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 274/540] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:50 2022] GET /compute/v2.1/servers/669a2c33-db1e-4179-82b4-f2574faacc3c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:19:50.099295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:50.099985 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:50.109351 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:50.109817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:50.110649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:50.111081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:50.135597 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-51857638-79cf-49f0-b032-990b65f709ad tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/ips" status: 200 len: 152 microversion: 2.20 time: 0.041213 Aug 02 10:19:50.136247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 267/541] 10.222.0.82 () {60 vars in 1289 bytes} [Tue Aug 2 10:19:50 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:19:50.456888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:50.457775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:50.476896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:50.477461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:50.478366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:50.478905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:50.620418 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:50.629224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a157d50b-2bab-48ab-bf65-fcc7f6cabc5a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.177684 Aug 02 10:19:50.629672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 275/542] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:50 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:51.650903 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:51.651494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:51.658472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:51.658912 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:51.659807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:51.660360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:51.791489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:51.795020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:51.799920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7bfd71d9-2b32-465d-b12b-9c0707492dff tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.153155 Aug 02 10:19:51.800487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 268/543] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:51 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:52.820525 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:52.821095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:52.827633 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:52.828083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:52.828850 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:52.829288 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:52.961100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:52.968693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-71c8d42b-9bb4-4c3b-a10b-9a3ed12cfabc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.152143 Aug 02 10:19:52.969251 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 276/544] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:52 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:53.129597 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:53.130168 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:53.138095 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:53.138533 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:53.139287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:53.139714 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:53.163457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lazy-loading 'flavor' on Instance uuid f67576fd-f413-48a6-b4ca-401e450e7f14 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:19:53.341447 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-310df802-d5a0-4b88-8215-f44b4b5b2aa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/action" status: 202 len: 0 microversion: 2.20 time: 0.215692 Aug 02 10:19:53.342085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 269/545] 10.222.0.82 () {62 vars in 1319 bytes} [Tue Aug 2 10:19:53 2022] POST /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:19:53.351105 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:53.351773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:53.358202 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:53.358770 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:53.359681 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:53.360841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:53.495367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:53.503216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:53.504713 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:53.506018 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-24155723-7cb7-403d-8342-2e7ad7fb4c39 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.158841 Aug 02 10:19:53.506571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 277/546] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:19:53 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:19:53.990021 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:53.990755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:53.997036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:53.997488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:53.998287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:53.998732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:54.131767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:54.139689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e594d042-f7e6-4da9-a12e-9bdb3ebc2517 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.153906 Aug 02 10:19:54.140249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 270/547] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:53 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:54.529125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:54.529745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:54.537035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:54.537489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:54.538279 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:54.538716 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:54.666954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:54.675373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:54.676888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:54.678068 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ce7b6af9-dc90-435d-86cd-f2e207060cf4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.152808 Aug 02 10:19:54.678638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 278/548] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:19:54 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:19:55.161279 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:55.161931 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:55.168407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:55.168858 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:55.169627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:55.170096 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:55.303243 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:55.311100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c80b7d98-6c29-4908-ac48-3b4c6da97da5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.154114 Aug 02 10:19:55.311670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 271/549] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:55 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:55.701978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:55.702608 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:55.709897 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:55.710356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:55.711122 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:55.711557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:55.842910 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:55.850887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:55.852443 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:55.854165 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-eb85631c-a51b-4d63-b80a-5f71e98575dc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.156109 Aug 02 10:19:55.854726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 279/550] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:19:55 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:19:56.332498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:56.333112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:56.339182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:56.339633 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:56.340394 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:56.340829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:56.472634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:56.479923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-09cb7608-fd18-4099-afa2-1f9abba5fe2d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1371 microversion: 2.1 time: 0.151544 Aug 02 10:19:56.480474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 272/551] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:56 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:56.877007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:56.877645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:56.884240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:56.884692 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:56.885449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:56.885912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:57.016150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:57.024478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:57.026030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:57.027195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0923567f-2c4f-4070-ad21-d9f9d30453c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.154122 Aug 02 10:19:57.027757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 280/552] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:19:56 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:19:57.501436 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:57.502145 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:57.509967 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:57.510439 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:57.511203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:57.511605 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:57.644358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:57.652226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cd5e754a-e6a3-4f3a-baf4-e2aaa59de4f5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1565 microversion: 2.1 time: 0.155366 Aug 02 10:19:57.652793 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 273/553] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:19:57 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:19:57.673956 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:57.674526 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:57.680646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:57.681096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:57.681889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:57.682325 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:57.770237 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1fcc2e56-7363-4ccd-887e-a213f5ee509a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100504 Aug 02 10:19:57.770849 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 281/554] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:19:57 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:58.050714 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:58.051321 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:58.057348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:58.057845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:58.058628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:58.059067 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:58.292030 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:58.304459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:58.305997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:58.307601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-51ee4b05-c09f-44dd-bcc0-d8cc5fa561f5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.260598 Aug 02 10:19:58.308526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 274/555] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:19:58 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:19:59.174273 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-ea4097ac-4601-4dc5-b1e1-12d21ad85a46 req-6c34e260-5beb-4069-aee2-9c99923923c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d69ccee-5a6a-4991-9ef2-38f45d65faf2", "tag": "d7fdcba9-37a2-4374-96d7-ddbf45910b7a"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:59.191986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ea4097ac-4601-4dc5-b1e1-12d21ad85a46 req-6c34e260-5beb-4069-aee2-9c99923923c8 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:59.192790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ea4097ac-4601-4dc5-b1e1-12d21ad85a46 req-6c34e260-5beb-4069-aee2-9c99923923c8 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:59.197488 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=100 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:59.209226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-ea4097ac-4601-4dc5-b1e1-12d21ad85a46 req-6c34e260-5beb-4069-aee2-9c99923923c8 service nova] Creating event network-changed:d7fdcba9-37a2-4374-96d7-ddbf45910b7a for instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 on hv-cinder-84713 Aug 02 10:19:59.215801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-ea4097ac-4601-4dc5-b1e1-12d21ad85a46 req-6c34e260-5beb-4069-aee2-9c99923923c8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046186 Aug 02 10:19:59.217338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 282/556] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:19:59.337887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:19:59.339526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:59.348164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:59.349303 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:59.350469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:59.351231 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:59.589583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:59.599115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:59.603032 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:19:59.604493 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-308443f1-ca4d-4470-abab-81333b8a2aaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.271691 Aug 02 10:19:59.605887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 275/557] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:19:59 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:19:59.928275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f71879d-c501-4b95-a8c6-0de37926e23c"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:19:59.930785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:19:59.940425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:59.941280 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:19:59.942518 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:19:59.944123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:00.314871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0095d3f3-fc8d-40c1-b50f-ee26cad96669 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390828 Aug 02 10:20:00.315506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 283/558] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:19:59 2022] POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:20:00.628054 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:00.629358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:00.636544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:00.637002 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:00.638020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:00.638619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:00.797693 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:00.806051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:00.807547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:00.808709 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-645003ae-cde5-45a6-bfc6-e84660c5bf63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.184897 Aug 02 10:20:00.809258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 276/559] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:00 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:01.834652 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:01.836583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:01.846412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:01.846903 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:01.847783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:01.848217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:02.035184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:02.043819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:02.045701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:02.047186 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4d6288dd-7910-4a0f-b9f9-bd9a068ab588 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.218486 Aug 02 10:20:02.048748 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 284/560] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:01 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:03.071976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:03.073450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:03.080940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:03.081370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:03.082198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:03.083005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:03.273133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:03.283395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:03.285475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:03.287104 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-884af909-27a7-4e0d-8fd9-172a4e2460ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.218973 Aug 02 10:20:03.305890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 277/561] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:03 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:04.312002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:04.312931 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:04.320522 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:04.320997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:04.322128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:04.322596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:04.479266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:04.488027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:04.489578 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:04.490877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-aa20bdff-7225-4903-85e7-687db9bc0fb2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.183105 Aug 02 10:20:04.491523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 285/562] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:04 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:05.516788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:05.517409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:05.525317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:05.525533 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:05.530257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:05.530692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:05.726975 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:05.736907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:05.738713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:05.740365 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-aaed5703-73f4-42ba-bda5-0532425cbf11 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.227710 Aug 02 10:20:05.757812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 278/563] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:05 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:06.766458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:06.767916 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:06.770675 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=56 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:06.777074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:06.777527 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:06.778334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:06.778767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:06.934498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:06.943460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:06.944962 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:06.946124 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4d2368cc-b981-4232-a348-2d57fdb9f42a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.183718 Aug 02 10:20:06.958138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 286/564] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:06 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:07.968754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:07.970916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:07.977769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:07.978773 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:07.979799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:07.980456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:08.150943 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:08.159821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:08.161396 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:08.162550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-744833a1-1373-4f36-b421-4f9e58a71e25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.198051 Aug 02 10:20:08.163101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 279/565] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:07 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:09.182387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3c564613-842b-40b6-8a6a-4b8d0574b79a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:20:09.186729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:09.187315 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:09.191540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3c564613-842b-40b6-8a6a-4b8d0574b79a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:09.192280 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3c564613-842b-40b6-8a6a-4b8d0574b79a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:09.197439 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:09.197922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:09.198729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:09.199217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:09.277431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3c564613-842b-40b6-8a6a-4b8d0574b79a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Going to try to stop instance {{(pid=118032) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 10:20:09.342901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3c564613-842b-40b6-8a6a-4b8d0574b79a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action" status: 202 len: 0 microversion: 2.1 time: 0.164076 Aug 02 10:20:09.346986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 287/566] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:20:09 2022] POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:20:09.354054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:09.354811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:09.355027 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:09.364117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:09.364575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:09.365224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:09.365444 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:09.366098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:09.367112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:09.368409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-eddf1ed9-fd2e-4341-95ad-d1d9ce230061 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.186597 Aug 02 10:20:09.369549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 280/567] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:09 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:20:09.530809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:09.541855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-502a20cd-cb80-4c1b-93c0-e89b996c1257 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.192396 Aug 02 10:20:09.543852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 288/568] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:09 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:10.392229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:10.393663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:10.400329 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:10.401045 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:10.402095 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:10.402610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:10.552728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:10.563503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:10.564980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:10.565664 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:10.567217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:10.568546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9849190f-d9e2-4cb5-a52f-1f770baca068 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.180349 Aug 02 10:20:10.569452 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 281/569] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:10 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:20:10.572026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:10.572482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:10.573266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:10.573712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:10.742131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:10.754097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e41fc806-679e-4f5a-8dce-a8509733db89 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.194462 Aug 02 10:20:10.755345 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 289/570] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:10 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:11.594188 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:11.596165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:11.603448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:11.604225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:11.605200 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:11.605715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:11.768752 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:11.776695 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:11.778252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:11.781342 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:11.785096 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:11.786402 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:11.786881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1c05cf3a-0cf5-4e8a-9c01-f450d303f200 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.196892 Aug 02 10:20:11.787333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:11.787745 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 282/571] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:11 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:11.788655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:11.789321 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:11.928891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:11.938064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5db21504-a3cd-4a23-8e60-a784f1883a31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.165350 Aug 02 10:20:11.938719 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 290/572] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:11 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:12.815170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:12.815945 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:12.818671 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:12.824163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:12.824905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:12.825893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:12.826336 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:12.855152 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:12.960784 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:12.962772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:12.971114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:12.971559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:12.972330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:12.972770 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:13.059682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:13.070604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:13.072710 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:13.073922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e6930d85-d30c-4cd9-a7c2-d75fb8b11492 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.263378 Aug 02 10:20:13.089682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 283/573] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:12 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:13.142644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:13.158611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-39b9f2dd-d23a-41ba-929e-071a663ad64d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.201637 Aug 02 10:20:13.159207 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 291/574] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:12 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:14.097069 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:14.098022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:14.104827 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:14.105277 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:14.106066 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:14.106506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:14.185994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:14.187271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:14.193461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:14.193940 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:14.194701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:14.195128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:14.252139 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:14.260149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:14.261748 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:14.263046 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3a9804bf-1aed-4b2a-a9c9-a544e9161cf8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.170461 Aug 02 10:20:14.263876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 284/575] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:14 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:14.367490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:14.375563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5c7a3053-f7f8-4332-984a-ad7a85e69172 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.193712 Aug 02 10:20:14.378160 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 292/576] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:14 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:15.287567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:15.288185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:15.294681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:15.295132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:15.295894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:15.296332 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:15.398245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:15.399170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:15.406449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:15.406900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:15.408290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:15.409187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:15.427338 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:15.435111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:15.439950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:15.441177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c493b78f-3f72-4605-8bcd-b9ce995b416f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.157559 Aug 02 10:20:15.441830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 285/577] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:15 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:15.562721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:15.570605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0f69879f-9a4d-4ae7-8ac8-5c676cb1f62e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.176151 Aug 02 10:20:15.571164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 293/578] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:15 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:16.467179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:16.468392 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:16.477483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:16.478085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:16.479011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:16.479645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:16.592127 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:16.592802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:16.599996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:16.600451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:16.601223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:16.601646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:16.612470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:16.620636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:16.622416 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:16.623640 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f9085f98-5f62-42c1-a430-32f1f254a71a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.162097 Aug 02 10:20:16.624197 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 286/579] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:16 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:20:16.732609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:16.741390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8f147ba3-da02-4959-a8ae-6b6b2971eee9 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.153153 Aug 02 10:20:16.741987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 294/580] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:16 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:17.648699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:17.649334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:17.655987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:17.656440 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:17.657224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:17.658256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:17.763324 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:17.763978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:17.771280 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:17.771942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:17.772980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:17.773443 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:17.791898 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:17.800051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:17.801562 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:17.802770 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d29f25c4-6541-475e-a462-ac8faa0aee29 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.158731 Aug 02 10:20:17.803370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 287/581] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:17 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:17.931512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:17.943031 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-117c22f8-c816-4995-a7a7-d7ab98280f73 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.183529 Aug 02 10:20:17.943824 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 295/582] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:17 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:18.068062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-87f41009-667d-4b49-ace6-a46353b501df req-b16ad0e1-08f5-41c6-a57b-7ceefeda0b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "name": "network-vif-plugged", "status": "completed", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:20:18.080758 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-87f41009-667d-4b49-ace6-a46353b501df req-b16ad0e1-08f5-41c6-a57b-7ceefeda0b05 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:18.081210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-87f41009-667d-4b49-ace6-a46353b501df req-b16ad0e1-08f5-41c6-a57b-7ceefeda0b05 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:18.093888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-87f41009-667d-4b49-ace6-a46353b501df req-b16ad0e1-08f5-41c6-a57b-7ceefeda0b05 service nova] Creating event network-vif-plugged:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:20:18.099604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-87f41009-667d-4b49-ace6-a46353b501df req-b16ad0e1-08f5-41c6-a57b-7ceefeda0b05 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037045 Aug 02 10:20:18.100688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 288/583] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:20:18.826514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:18.827123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:18.833614 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:18.834129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:18.834898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:18.835340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:18.965707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:18.966294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:18.966616 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:18.973470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:18.974041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:18.974768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:18.974956 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:18.975460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:18.976259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:18.977400 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-aaf87662-c73c-4a09-8e58-1ac30fa8162b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.154814 Aug 02 10:20:18.978260 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 296/584] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:18 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:19.109157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:19.117188 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d3b9c068-3074-47fb-81df-14b57a19e05f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.156552 Aug 02 10:20:19.117750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 289/585] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:18 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:20.000120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:20.000737 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:20.007968 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:20.008427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:20.009193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:20.009631 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:20.013665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:20.138311 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:20.138864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:20.144896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:20.145236 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:20.145696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:20.146619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:20.147056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:20.153220 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:20.154761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:20.155949 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a36f3010-b13b-4770-a171-871325164a0c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.159790 Aug 02 10:20:20.156513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 297/586] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:19 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:20.275221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:20.283769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-122b657a-cf43-4312-adc0-a383c047a300 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.149419 Aug 02 10:20:20.284333 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 290/587] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:20 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:21.180324 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:21.180892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:21.187587 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.188035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.189403 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.189872 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.306712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:21.307364 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:21.315009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.315466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.316245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:21.316699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:21.322075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:21.330895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:21.332416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:21.333572 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8c1caad8-6efc-43c0-92b9-2b36cd036afc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1746 microversion: 2.20 time: 0.157247 Aug 02 10:20:21.334242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 298/588] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:21 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:21.450447 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:21.458806 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c7fe2b09-d35f-4529-9f76-c38766f172f8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.155999 Aug 02 10:20:21.459382 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 291/589] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:21 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:22.357563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:22.358214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:22.365174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:22.365626 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:22.366445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:22.366888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:22.480303 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:22.481105 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:22.488189 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:22.488637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:22.489510 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:22.489926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:22.505195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:22.515980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:22.518323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:22.520466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1f600d09-156d-4c50-acd9-0fd66a397e32 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.166055 Aug 02 10:20:22.521829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 299/590] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:22 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:22.630760 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:22.638902 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-66359046-efa4-441a-b613-1d2e1ebba04a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.162413 Aug 02 10:20:22.639546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 292/591] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:22 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:23.546808 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:23.549539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:23.559291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:23.560007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:23.561652 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:23.562303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:23.665748 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:23.666828 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:23.680198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:23.680663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:23.686545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:23.695766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:23.716763 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:23.726095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:23.731195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:23.732460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-34d87a9b-558d-494b-9e85-72be494e9ed6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.190711 Aug 02 10:20:23.733100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 300/592] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:23 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:23.873719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:23.885392 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f5d65978-bc1c-4c93-acb5-1c4b019d227a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.227144 Aug 02 10:20:23.903521 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 293/593] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:23 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:24.757929 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:24.760166 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:24.767333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:24.768109 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:24.769753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:24.770479 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:24.911400 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:24.912100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:24.912562 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:24.918545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:24.919298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:24.920581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:24.921251 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:24.921653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:24.923370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:24.925147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3ba00fba-a647-4ed0-b02d-4f7f1566196f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.171550 Aug 02 10:20:24.937825 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 301/594] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:24 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:25.077840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:25.089259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bbc34f1c-8804-4132-9f2e-fca5fbffd796 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.181838 Aug 02 10:20:25.091961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 294/595] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:24 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:25.953114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:25.953728 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:25.961136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:25.961589 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:25.962392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:25.963011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:26.112610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:26.113887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:26.117865 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:26.121165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:26.122252 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:26.123175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:26.123619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:26.126833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:26.130445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:26.131810 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0e24bb2f-2813-41ad-9c66-2632c514f342 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.185210 Aug 02 10:20:26.149295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 302/596] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:25 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:26.293937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:26.307051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b62e6f6c-04f6-4b61-9f05-a7dad2cff64a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.198114 Aug 02 10:20:26.322147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 295/597] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:26 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:27.155998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:27.156567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:27.165445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:27.166020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:27.166868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:27.167373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:27.331833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:27.333472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:27.334730 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:27.343408 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:27.344612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:27.345253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:27.345979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:27.346474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1a9912ce-8d87-431e-ad84-18363e12f965 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.194669 Aug 02 10:20:27.347714 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 303/598] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:27 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:20:27.349010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:27.349538 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:27.491282 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:27.500350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-54878014-d6d6-4104-b8ae-4e49ecc4295d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.173297 Aug 02 10:20:27.514966 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 296/599] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:27 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:28.369966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:28.370785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:28.377550 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:28.378431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:28.379501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:28.380194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:28.523043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:28.523655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:28.531939 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:28.532679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:28.533601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:28.534654 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:28.557182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:28.568141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:28.570923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:28.573323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f9c68bc6-a8f7-408a-a70f-1d6525d563d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.207012 Aug 02 10:20:28.574152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 304/600] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:28 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:28.685538 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:28.702383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f91cc0e8-f6ff-4d74-8e70-c2a7e31c6200 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.183343 Aug 02 10:20:28.702963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 297/601] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:28 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:29.597263 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:29.597993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:29.605813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:29.606490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:29.607458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:29.607896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:29.728125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:29.729146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:29.741639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:29.742221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:29.743253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:29.743959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:29.802296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:29.814565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:29.816453 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:29.818077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ca5cc863-85f3-457e-ae2e-4cf8c33b76a5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.224701 Aug 02 10:20:29.819664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 305/602] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:29 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:29.905776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:29.923658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f3b0dabb-5860-44f9-8ad2-bd62d60b2558 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1721 microversion: 2.1 time: 0.197724 Aug 02 10:20:29.925680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 298/603] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:29 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:20:30.842693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:30.843310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:30.850017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:30.850476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:30.851260 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:30.851704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:30.947704 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:30.948324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:30.955661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:30.956244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:30.957438 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:30.957560 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:30.993827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:31.003721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:31.010893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:31.012173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-12ad8eaf-8106-4d4f-a122-790643525ca5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.173398 Aug 02 10:20:31.013006 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 306/604] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:30 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:20:31.116040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:31.123908 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f9104328-5b97-4bf3-a914-1111e6e38132 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1698 microversion: 2.1 time: 0.180239 Aug 02 10:20:31.124471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 299/605] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:30 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:31.147892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-75acc7d6-9811-4e61-8957-1f5127cd2e42 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:20:31.154111 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-75acc7d6-9811-4e61-8957-1f5127cd2e42 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:31.154553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-75acc7d6-9811-4e61-8957-1f5127cd2e42 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:31.178135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-75acc7d6-9811-4e61-8957-1f5127cd2e42 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Going to try to start instance {{(pid=118032) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 10:20:31.222328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-75acc7d6-9811-4e61-8957-1f5127cd2e42 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action" status: 202 len: 0 microversion: 2.1 time: 0.078084 Aug 02 10:20:31.225978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 307/606] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:20:31 2022] POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:20:31.232289 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:31.233820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:31.245887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:31.246756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:31.247841 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:31.248276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:31.458332 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:31.462163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:31.467842 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-57d2a46e-229d-49a6-8789-034c35b9173b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1707 microversion: 2.1 time: 0.240429 Aug 02 10:20:31.468772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 300/607] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:31 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1707 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:32.037584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:32.040565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:32.053882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:32.054904 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:32.056338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:32.057080 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:32.212806 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:32.221396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:32.223470 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:32.224700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7a14d304-3de5-4766-95e1-5d95e10e0e27 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.192781 Aug 02 10:20:32.225483 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 308/608] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:32 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:32.490938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:32.491587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:32.498191 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:32.498649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:32.499547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:32.499934 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:32.627413 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:32.636329 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f613a31d-c3a6-499b-a448-d236b58b2499 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1707 microversion: 2.1 time: 0.149884 Aug 02 10:20:32.636894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 301/609] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:32 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:33.250206 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:33.250820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:33.258115 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:33.258566 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:33.259328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:33.259848 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:33.386253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:33.394573 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:33.396073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:33.397224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f2edf00d-61a6-47ee-a37a-1447378fd4a4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1741 microversion: 2.20 time: 0.151036 Aug 02 10:20:33.397807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 309/610] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:33 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:33.658166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:33.658709 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:33.665239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:33.665690 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:33.666490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:33.666928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:33.801423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:33.809544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b40ac0c1-4c0f-4e01-a9b0-a691fdfb2492 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1711 microversion: 2.1 time: 0.155357 Aug 02 10:20:33.810162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 302/611] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:20:33 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:20:34.420774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:34.421972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:34.428667 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:34.429120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:34.429935 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:34.430373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:34.833332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:34.841342 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:34.843051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:34.844204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3038dfe0-d2f3-40a8-9923-e6f6f20843a6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1723 microversion: 2.20 time: 0.427619 Aug 02 10:20:34.844769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 310/612] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:34 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:35.866928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:35.867570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:35.874115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:35.874593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:35.875352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:35.875785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:36.009924 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:36.017885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:36.019980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:36.021162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d20aa93c-c1d5-4b0a-9ed5-82531c8faa5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1723 microversion: 2.20 time: 0.158122 Aug 02 10:20:36.021969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 303/613] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:35 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:36.073614 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-a1997729-a2cd-4f52-bcdf-777d5a85b565 req-98a18188-0b1a-459b-8863-2c348f10ca51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "name": "network-vif-unplugged", "status": "completed", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:20:36.084299 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-a1997729-a2cd-4f52-bcdf-777d5a85b565 req-98a18188-0b1a-459b-8863-2c348f10ca51 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:36.084743 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-a1997729-a2cd-4f52-bcdf-777d5a85b565 req-98a18188-0b1a-459b-8863-2c348f10ca51 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:36.095644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-a1997729-a2cd-4f52-bcdf-777d5a85b565 req-98a18188-0b1a-459b-8863-2c348f10ca51 service nova] Creating event network-vif-unplugged:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:20:36.100293 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-a1997729-a2cd-4f52-bcdf-777d5a85b565 req-98a18188-0b1a-459b-8863-2c348f10ca51 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030490 Aug 02 10:20:36.100878 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 311/614] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:20:37.046420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:37.047190 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:37.053914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.054373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.055138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.055576 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.183787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:37.191931 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:37.193446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:37.194646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-38a9c840-12da-434c-8a9e-48569e5c4c84 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1726 microversion: 2.20 time: 0.154505 Aug 02 10:20:37.195209 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 304/615] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:37 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:37.218355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c92ab5b-1644-4f5c-99fb-59cb0dade2f2"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:20:37.220767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:37.223276 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=52 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:37.228816 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.229267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.230069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.230512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.404809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:37.516282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-476fffff-f63c-4a01-abdd-67c5303e67ac tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302663 Aug 02 10:20:37.522709 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 312/616] 10.222.0.82 () {62 vars in 1364 bytes} [Tue Aug 2 10:20:37 2022] POST /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:20:37.636635 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:20:37.637262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:37.643526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.643984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.644759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.645194 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.687819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118031) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 10:20:37.754055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-08df2abd-9fd1-400b-a8a9-c0cd0ad0eaaf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/action" status: 202 len: 0 microversion: 2.20 time: 0.120543 Aug 02 10:20:37.754659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 305/617] 10.222.0.82 () {62 vars in 1319 bytes} [Tue Aug 2 10:20:37 2022] POST /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:20:37.762868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:37.763584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:37.769906 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.770363 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.771142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:37.771589 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:37.922768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:37.931802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:37.933382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:37.934577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4332b219-ee82-479f-95b2-1f58f8e257c8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1752 microversion: 2.20 time: 0.175726 Aug 02 10:20:37.935134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 313/618] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:37 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:38.958732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:38.959496 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:38.965799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:38.966264 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:38.967031 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:38.967463 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:39.098701 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:39.107021 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:39.108526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:39.109693 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0225ff59-c4df-42ae-91ea-28bbcddbb63a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1754 microversion: 2.20 time: 0.155497 Aug 02 10:20:39.110298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 306/619] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:38 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:40.133862 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:40.134474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:40.141119 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:40.141561 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:40.142348 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:40.142783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:40.361620 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:40.370897 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:40.372396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:40.373557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-860443ac-023e-4ec6-bcc0-2aefe1964859 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.244326 Aug 02 10:20:40.374152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 314/620] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:40 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:41.397236 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:41.397762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:41.405113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:41.405567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:41.406420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:41.406857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:41.542007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:41.550799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:41.552326 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:41.553647 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-eda260a8-f8d4-4f12-9ec6-793f36b47b79 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.160911 Aug 02 10:20:41.554451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 307/621] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:41 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:42.577305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:42.577960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:42.585623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:42.586104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:42.586941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:42.587413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:42.729330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:42.737661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:42.739260 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:42.740437 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b4bd3ef1-8386-4972-816e-ef704f38fd3d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.167165 Aug 02 10:20:42.740998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 315/622] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:42 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:43.764023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:43.764692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:43.766917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:43.772301 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:43.772746 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:43.773498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:43.773969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:43.909080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:43.919840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:43.931415 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:43.932657 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ff683857-6a79-44e3-9f27-733f3cd4c351 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.172612 Aug 02 10:20:43.933424 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 308/623] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:43 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:44.956569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:44.957714 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:44.964054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:44.964503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:44.965258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:44.965687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:45.114561 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:45.122913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:45.124404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:45.125556 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-08d987c6-7531-4d91-9548-d810a9626557 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.172927 Aug 02 10:20:45.126141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 316/624] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:44 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:46.148585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:46.149209 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:46.155650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:46.156095 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:46.156849 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:46.157277 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:46.290525 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:46.298805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:46.300304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:46.302066 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-52ec42c7-c565-40b2-a18e-e67dac407213 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.157493 Aug 02 10:20:46.302627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 309/625] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:46 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:47.329539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:47.331305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:47.339898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:47.340369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:47.341156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:47.341586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:47.488459 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:47.498236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:47.498236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:47.499320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-08faf269-7a93-4dce-a4ae-f5762623b1c9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.178624 Aug 02 10:20:47.500089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 317/626] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:47 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:48.532772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:48.534408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:48.544368 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:48.545208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:48.546064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:48.546500 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:48.690040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:48.698345 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:48.699855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:48.701011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b2150c7a-71ab-48e3-9ac6-c7e24a0f6d15 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.177707 Aug 02 10:20:48.701563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 310/627] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:48 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:49.724403 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:49.725048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:49.738019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:49.738477 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:49.739969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:49.740960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:49.884029 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:49.903389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:49.904892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:49.906099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-429c5b61-9f4c-4db4-bf28-ca3479e9cd36 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.185624 Aug 02 10:20:49.906657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 318/628] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:49 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:50.928886 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:50.929494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:50.936049 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:50.936490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:50.937245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:50.937970 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:51.106079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:51.115672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:51.117186 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:51.131449 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e8cb66c8-9eec-49c3-aca8-afe5b36c4241 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.206272 Aug 02 10:20:51.132035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 311/629] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:50 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:52.155325 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:52.155928 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:52.162895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:52.163341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:52.164136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:52.164567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:52.306262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:52.315427 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:52.316959 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:52.318325 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-045f3789-5e65-4904-8c6d-c80951ec8f81 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.166962 Aug 02 10:20:52.318884 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 319/630] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:52 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:53.343634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:53.345015 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:53.351681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:53.352483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:53.353457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:53.353745 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:53.512658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:53.522812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:53.524478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:53.525950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-76b03963-c1a6-4482-8f16-0b80fc529abc tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.187257 Aug 02 10:20:53.526714 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 312/631] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:53 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:54.548977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:54.549580 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:54.556160 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:54.556609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:54.557374 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:54.557838 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:54.687900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:54.696285 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:54.697773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:54.698947 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a7866f16-e562-4282-aaf5-26cce9e73d3b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.153881 Aug 02 10:20:54.699571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 320/632] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:54 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:55.721933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:55.722588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:55.728956 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:55.729398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:55.730179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:55.730614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:55.858158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:55.867055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:55.868560 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:55.869716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f610256d-a0b6-4730-9e7a-85199f286513 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.151707 Aug 02 10:20:55.870300 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 313/633] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:55 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:56.893991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:56.894605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:56.901075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:56.901524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:56.902317 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:56.902757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:57.033070 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:57.041924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:57.043420 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:57.044570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-77ddeea9-0a0e-4165-b53c-a764e844b39e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.154553 Aug 02 10:20:57.045395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 321/634] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:56 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:58.068558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:58.069192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:58.075671 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:58.076115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:58.076867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:58.077296 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:58.207064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:58.215385 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:58.216892 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:58.218083 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1e997eaf-ba65-4816-9892-d0cf4a80d71c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.153963 Aug 02 10:20:58.218643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 314/635] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:58 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:20:59.240498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:20:59.241101 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:20:59.247661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:59.248103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:59.248864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:20:59.249298 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:20:59.386496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:59.394914 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:59.396412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:20:59.397651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0b0bef5f-77d3-4eea-aef9-65bf32100c85 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.161054 Aug 02 10:20:59.398249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 322/636] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:20:59 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:00.420983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:00.421604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:00.428750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:00.429203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:00.430000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:00.430437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:00.525514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:00.527936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:00.534469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:00.534920 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:00.536180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:00.536625 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:00.560081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:00.568868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:00.570351 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:00.571530 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5ee694d4-4750-46b2-bccb-b826f2d57826 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.154459 Aug 02 10:21:00.572100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 315/637] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:00 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:00.608491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5d3dad2f-5cc7-46a4-9c38-4e4724c085d0 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/action" status: 202 len: 0 microversion: 2.1 time: 0.086656 Aug 02 10:21:00.609113 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 323/638] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:21:00 2022] POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:21:00.618055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:00.619065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:00.625044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:00.625502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:00.626309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:00.626794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:00.646245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:00.855138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:00.863012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-77db9301-a35a-44ee-87b9-e86e2d8a1254 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1751 microversion: 2.1 time: 0.249769 Aug 02 10:21:00.863578 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 316/639] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:00 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:01.594807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:01.595505 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:01.602309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:01.602757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:01.603532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:01.603952 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:01.782135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:01.791145 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:01.792664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:01.793848 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8d247d61-e9e6-4a72-bafd-499321bc7d06 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.203830 Aug 02 10:21:01.794415 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 324/640] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:01 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:01.884934 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:01.885550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:01.892019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:01.892468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:01.893228 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:01.893662 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:02.086492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:02.094455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f09d98a3-cf77-4c84-8d74-ef0b21005559 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.213454 Aug 02 10:21:02.095020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 317/641] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:01 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:02.817304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:02.817956 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:02.824603 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:02.825434 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:02.825877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:02.826319 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:03.049645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:03.059043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:03.060594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:03.061770 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d15ccfc3-c9e0-498a-8b96-9c584cdd0428 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.248644 Aug 02 10:21:03.062425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 325/642] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:02 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:03.115900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:03.116928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:03.124749 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:03.125772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:03.126582 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:03.127020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:03.382546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:03.390402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f0744fee-7e20-4ddf-a799-1cfd5fb9837a tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.278297 Aug 02 10:21:03.390974 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 318/643] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:03 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:04.085965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:04.086584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:04.093115 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:04.093568 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:04.094379 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:04.094817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:04.111226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:04.245462 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:04.255948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:04.257455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:04.258654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-fd46eb85-8bb8-446b-8a00-0e6623d703b0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.177999 Aug 02 10:21:04.259218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 326/644] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:04 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:04.412053 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:04.412573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:04.419241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:04.419685 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:04.420484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:04.420916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:04.570376 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:04.578824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b007db2a-9e1a-4b38-aec4-63529d3ec990 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.170702 Aug 02 10:21:04.579479 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 319/645] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:04 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:05.288087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:05.288739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:05.295275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:05.295730 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:05.296501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:05.296934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:05.428709 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:05.437061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:05.438854 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:05.440013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-35ad7a4c-973e-49b6-b4b9-2dfbbde58fb9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.156339 Aug 02 10:21:05.440572 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 327/646] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:05 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:05.600622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:05.601159 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:05.607688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:05.608138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:05.608906 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:05.609354 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:05.752558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:05.761001 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e291d543-19a1-4922-90dc-2d749d489f8b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.164984 Aug 02 10:21:05.761566 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 320/647] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:05 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:06.462850 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:06.463383 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:06.470218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:06.470732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:06.472082 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:06.472648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:06.602133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:06.610490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:06.611994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:06.613156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8bb7e816-7696-4e6a-b042-e9d1c6a1500e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.154279 Aug 02 10:21:06.613710 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 328/648] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:06 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:06.782121 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:06.782739 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:06.789759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:06.790245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:06.791001 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:06.791439 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:06.936086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:06.944295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-91626c45-49f2-48e9-87c0-973b6ddf421c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.166078 Aug 02 10:21:06.944862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 321/649] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:06 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:07.636988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:07.637601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:07.639945 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=34 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:07.645158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:07.645604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:07.646385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:07.646823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:07.774725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:07.783371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:07.784870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:07.786057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bb4883ab-59a4-49f7-ba04-8795ae3c6b16 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.152938 Aug 02 10:21:07.786615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 329/650] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:07 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:07.965318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:07.965901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:07.972446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:07.972929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:07.974235 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:07.974671 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:08.145526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:08.153912 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9e679b86-115e-48e4-bf92-3e6de53f2d24 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.192493 Aug 02 10:21:08.154603 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 322/651] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:07 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:08.278800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-19380a32-ac00-49d9-ac3a-4575fcd0baf6 req-5a5cf416-b0ca-4571-b9e9-397739d48d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "name": "network-vif-plugged", "status": "completed", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:08.289671 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-19380a32-ac00-49d9-ac3a-4575fcd0baf6 req-5a5cf416-b0ca-4571-b9e9-397739d48d3d service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:08.290157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-19380a32-ac00-49d9-ac3a-4575fcd0baf6 req-5a5cf416-b0ca-4571-b9e9-397739d48d3d service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:08.302034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-19380a32-ac00-49d9-ac3a-4575fcd0baf6 req-5a5cf416-b0ca-4571-b9e9-397739d48d3d service nova] Creating event network-vif-plugged:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:21:08.306981 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-19380a32-ac00-49d9-ac3a-4575fcd0baf6 req-5a5cf416-b0ca-4571-b9e9-397739d48d3d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032087 Aug 02 10:21:08.307732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 330/652] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:21:08.808984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:08.809679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:08.816578 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:08.817036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:08.818022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:08.818724 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:09.057753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:09.066985 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:09.068501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:09.069775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bef701b5-f7b5-47d7-abbe-fb0eb96e9d69 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.264877 Aug 02 10:21:09.070410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 323/653] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:08 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:09.179933 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:09.180726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:09.187130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:09.187580 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:09.188611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:09.189048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:09.334968 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:09.343074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ba835c00-4433-48d3-9aff-9cc96f6dd5c2 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.168214 Aug 02 10:21:09.343646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 331/654] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:09 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:10.093317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:10.093896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:10.101162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:10.101620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:10.102434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:10.102878 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:10.243345 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:10.251738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:10.253237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:10.254430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e9bf2602-dd56-4514-ad08-a85ef3893dd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.165110 Aug 02 10:21:10.255509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 324/655] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:10 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:10.365014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:10.365559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:10.372223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:10.372672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:10.373435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:10.373900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:10.528720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:10.536774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9daa55fd-2a44-4033-8f16-cc0b8c4ba57f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.175691 Aug 02 10:21:10.537343 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 332/656] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:10 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:11.277446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:11.278244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:11.285237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:11.285692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:11.287545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:11.287991 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:11.420346 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:11.429339 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:11.430979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:11.432653 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b36b493c-f177-441a-a965-b0ce4aafa660 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1810 microversion: 2.20 time: 0.159063 Aug 02 10:21:11.433177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 325/657] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:11 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:11.562978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:11.563932 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:11.570942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:11.571393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:11.572156 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:11.572590 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:11.725310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:11.733414 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e5a65bd9-ed60-4f42-86f0-be58504af9e6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.174830 Aug 02 10:21:11.734009 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 333/658] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:11 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:12.456286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.456901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:12.464265 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:12.464720 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:12.465489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:12.465961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:12.597193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:12.605646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:12.607210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:12.608370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d2c5d46f-8a42-4ddb-a22b-9cbf58519b9b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1797 microversion: 2.20 time: 0.156015 Aug 02 10:21:12.608926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 326/659] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:21:12 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1797 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:21:12.754509 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:12.755621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:12.762143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:12.762595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:12.763364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:12.763811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:12.906715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:12.914606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c35950d8-93c1-4266-814a-2a655052eafb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.163940 Aug 02 10:21:12.915185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 334/660] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:12 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:13.557718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:21:13.558307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:21:13.935217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:13.935873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:13.938200 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=38 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:13.944353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:13.944800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:13.945553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:13.946015 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:14.087844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:14.095624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c0958cca-dac1-42b4-8519-2a6bcb76c595 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.164201 Aug 02 10:21:14.096167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 327/661] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:13 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:15.116071 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:15.116625 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:15.122821 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:15.123271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:15.124034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:15.124470 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:15.265085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:15.273713 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4667b1e8-11f6-4ab9-b257-7a6537d6586d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.161578 Aug 02 10:21:15.274303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 335/662] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:15 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:16.295642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:16.296252 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:16.302772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:16.303210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:16.303965 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:16.304396 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:16.447700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:16.455639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-584fc093-860c-4786-a20c-c1480cbdc2d4 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.163943 Aug 02 10:21:16.456196 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 328/663] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:16 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:17.477564 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:17.478226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:17.484705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:17.485155 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:17.485960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:17.486398 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:17.624865 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:17.633316 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8c3b2268-f2d0-42ea-9e85-a915ee669a57 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1756 microversion: 2.1 time: 0.159657 Aug 02 10:21:17.633901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 336/664] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:17 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:18.654737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:18.655282 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:18.662333 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:18.662779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:18.663551 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:18.663986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:18.813583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:18.822663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-abec93e9-5431-4106-944d-65f2d2890c1c tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1759 microversion: 2.1 time: 0.171827 Aug 02 10:21:18.823431 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 329/665] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:18 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:41.561575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=15 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:41.562359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=59 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:41.666139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:41.666637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:41.672616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.673068 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.677128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:41.677128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:41.795855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lazy-loading 'services' on Instance uuid df694e6a-8f96-4024-9f32-7fd36d7114fe {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:21:41.907889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-326b777c-fd53-4c9d-9996-cca833d06230 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-volume_attachments/4f71879d-c501-4b95-a8c6-0de37926e23c" status: 202 len: 0 microversion: 2.1 time: 0.351269 Aug 02 10:21:41.908474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 337/666] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:21:41 2022] DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-volume_attachments/4f71879d-c501-4b95-a8c6-0de37926e23c => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:21:43.033476 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7cfaba0d-e917-48cd-a005-9ec06d9b133e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:43.035589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=5 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:43.036245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=80 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:43.043407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7cfaba0d-e917-48cd-a005-9ec06d9b133e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:43.043865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7cfaba0d-e917-48cd-a005-9ec06d9b133e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:43.106401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7cfaba0d-e917-48cd-a005-9ec06d9b133e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Going to try to stop instance {{(pid=118031) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 10:21:43.146928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7cfaba0d-e917-48cd-a005-9ec06d9b133e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action" status: 202 len: 0 microversion: 2.1 time: 0.117244 Aug 02 10:21:43.147512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 330/667] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:21:43 2022] POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:21:43.156576 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:43.157275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:43.164594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:43.165047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:43.165886 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:43.166499 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:43.309048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:43.316953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d9abe9ca-4f93-476a-ab96-3f5048830c3c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.164519 Aug 02 10:21:43.317515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 338/668] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:43 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:44.340118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:44.340948 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:44.347176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.347628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.348393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.348832 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.475702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:44.483738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-36f18329-849a-4e41-9876-6f9441d4d514 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.148889 Aug 02 10:21:44.484292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 331/669] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:44 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:44.756264 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da6ba4c2-e79d-4f29-89ca-76c25f71df36"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:44.759221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:44.765233 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.765685 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:44.766506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:44.766938 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.022599 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5ee981c3-a141-4a2a-a554-72096ed2dbee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367177 Aug 02 10:21:45.023791 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 339/670] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:21:44 2022] POST /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:21:45.504271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:45.504895 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.511900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.512673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:45.513115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:45.648212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:45.656401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d948c2c3-915b-4b4f-befa-eaecfa8e26e3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.155980 Aug 02 10:21:45.657036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 332/671] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:45 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:46.680058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:46.680790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:46.687053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:46.687510 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.688282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:46.688722 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:46.818139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:46.825021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-471783cf-fa2e-448f-b826-2554d88818d2 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.150167 Aug 02 10:21:46.825660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 340/672] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:46 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:47.845230 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:47.845914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:47.852494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:47.852880 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:47.853811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:47.854253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:48.228809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:48.236164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c50050c4-7922-4d92-a4ea-3432555ea49f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.394743 Aug 02 10:21:48.236729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 333/673] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:47 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:49.257922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:49.258553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:49.265056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.265514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.266323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:49.266775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:49.400339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:49.407767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e46cfdce-0d47-4765-a0ce-c5bd777b428b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.154301 Aug 02 10:21:49.408332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 341/674] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:49 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:50.428348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:50.428996 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:50.435572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.436023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.436790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:50.437224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:50.567573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:50.574936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-99c8f8fc-6c0d-493c-937d-85143b49ee4c tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.150411 Aug 02 10:21:50.575495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 334/675] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:50 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:51.596803 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:51.597402 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:51.607520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:51.607972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:51.608740 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:51.609182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:51.739049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:51.747051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-77dd294b-549e-4b8b-8f44-e1a0e3a8ad71 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.154243 Aug 02 10:21:51.747615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 342/676] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:51 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:52.542157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:52.544484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:52.550936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.551391 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.552163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.552606 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.578457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lazy-loading 'flavor' on Instance uuid 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:21:52.704854 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-122ee4a7-e2fd-4689-b0f3-f307ab2b7c37 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/action" status: 200 len: 32 microversion: 2.1 time: 0.166692 Aug 02 10:21:52.705460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 335/677] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:21:52 2022] POST /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:21:52.715370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:52.715994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:52.722302 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.722797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.723732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.724178 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.768740 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:52.769516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:52.777747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.778432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.779224 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:52.779660 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:52.970152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:52.978166 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-47387088-48d9-43e2-9a8a-aafca9ced9ca tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.266504 Aug 02 10:21:52.978743 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 343/678] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:52 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:53.029958 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:53.037466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0c6a6eaf-3d0b-43bc-94b5-36a6327d6045 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1675 microversion: 2.1 time: 0.272878 Aug 02 10:21:53.038058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 336/679] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:52 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:53.999606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:54.000218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:54.006789 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.007243 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.008004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.008441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.059131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:54.059740 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:54.066344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.066788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.067581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.068009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.181864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.190654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cd5408c0-a129-4085-9676-0d086e6e48d4 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.194596 Aug 02 10:21:54.191230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 344/680] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:53 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:54.227370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.234674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-64fedca0-a4dc-4aa8-ad56-ef5fc0fad4b0 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1652 microversion: 2.1 time: 0.179915 Aug 02 10:21:54.235235 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 337/681] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:54 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1652 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:54.254805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d63967d4-7305-4756-b87a-65611979c394 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:21:54.260749 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d63967d4-7305-4756-b87a-65611979c394 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.261193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d63967d4-7305-4756-b87a-65611979c394 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.282752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d63967d4-7305-4756-b87a-65611979c394 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Going to try to start instance {{(pid=118032) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 10:21:54.322939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d63967d4-7305-4756-b87a-65611979c394 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action" status: 202 len: 0 microversion: 2.1 time: 0.071734 Aug 02 10:21:54.323592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 345/682] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:21:54 2022] POST /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:21:54.331811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:54.332429 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:54.339766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.340217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.341020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:54.341487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:54.503950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:54.512236 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d5a55ed9-8952-494d-9c7b-36991c6b0278 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1661 microversion: 2.1 time: 0.184259 Aug 02 10:21:54.512804 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 338/683] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:54 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1661 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:55.213501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:55.214227 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:55.220465 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.220915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.221670 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.222131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.357135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.365232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f334468f-f6b2-4f95-bba5-6f08cb87b71f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.156456 Aug 02 10:21:55.365810 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 346/684] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:55 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:55.533939 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:55.534590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:55.541017 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.541471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.542276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:55.542717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:55.677512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:55.685472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8ae97348-078c-49e9-a064-ce5c3b12af6a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1661 microversion: 2.1 time: 0.155417 Aug 02 10:21:55.686060 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 339/685] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:55 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:21:56.385680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:56.386356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:56.392964 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.393415 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.394222 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.394658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.526545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:56.534809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-31ab01cc-6a87-4d17-be07-b3d05be5de54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.153053 Aug 02 10:21:56.535366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 347/686] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:56 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:56.707452 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:56.708017 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:56.714684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.715132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.715896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:56.716331 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:56.844698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:56.852247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-37b4e87d-1503-48ca-9bf6-ce3ff9b4add6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1665 microversion: 2.1 time: 0.148670 Aug 02 10:21:56.852965 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 340/687] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:56 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:57.557514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:57.558137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:57.564619 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:57.565066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:57.566105 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:57.566534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:57.693487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:57.701354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-79217290-8d8a-4854-95c6-1cd8907f712a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.148400 Aug 02 10:21:57.701963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 348/688] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:57 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:58.722631 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:58.723290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:58.729755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:58.730240 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.731004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:58.731442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:58.866510 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:21:58.874976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2b5a1d56-13b5-4e07-94a4-4f301ad6f5a1 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.156155 Aug 02 10:21:58.875540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 341/689] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:58 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:21:59.896857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:21:59.897471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:21:59.904587 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.905034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:21:59.905812 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:21:59.906246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:00.033542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:00.041360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-149fdec2-b644-4f67-96ba-eb653f852f0d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.148424 Aug 02 10:22:00.041929 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 349/690] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:21:59 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:01.063291 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:01.063909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:01.070780 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.071239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.072014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:01.072456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:01.210267 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:01.218844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-90704119-679e-4a31-a33c-98f38906b59f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.159549 Aug 02 10:22:01.219410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 342/691] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:01 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:02.240138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:02.240765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:02.247372 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.247827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.248593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:02.249032 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:02.267331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:02.386221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:02.394179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d43c4e78-bf63-4047-aa1f-692c244df664 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.157943 Aug 02 10:22:02.394747 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 350/692] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:02 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:03.416466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:03.417088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:03.423740 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:03.424196 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:03.424966 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:03.425408 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:03.444374 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:03.613869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:03.622335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6fa63f82-cfd4-4506-936f-37cc9e6e5ef2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.210323 Aug 02 10:22:03.622891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 343/693] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:03 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:04.643653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:04.644182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:04.650753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.651199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.651955 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:04.652381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:04.778535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:04.786458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-91817f1b-92e9-444c-bc6c-627394cb9668 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.146714 Aug 02 10:22:04.787023 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 351/694] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:04 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:05.807545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:05.808167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:05.814668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:05.815123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.816145 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:05.816588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:05.946990 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:05.954887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9b2afecd-a609-4408-b967-e08d0f9fe1cf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.151160 Aug 02 10:22:05.955443 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 344/695] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:05 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:06.976760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:06.978020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:06.984540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:06.984985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:06.985742 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:06.986200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:07.115645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:07.123462 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d3ff1eec-dfa7-4f3d-9694-78c8a4a72ff3 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1736 microversion: 2.1 time: 0.150670 Aug 02 10:22:07.124232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 352/696] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:06 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:08.144573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:08.145146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:08.151617 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.152071 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.152841 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.153283 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.282369 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:08.290805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9e976d8d-b67b-48bd-96c8-1fa2cc732e9e tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1716 microversion: 2.1 time: 0.150156 Aug 02 10:22:08.291386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 345/697] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:08 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:08.350354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:08.350851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:08.357808 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.358268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.359034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.359471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.438149 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] HTTP exception thrown: Cannot 'detach_volume' instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 while it is in vm_state rescued Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Request method failure captured: Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments/da6ba4c2-e79d-4f29-89ca-76c25f71df36 HTTP/1.1 Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pl4Qg1fbk9Q6IAsiK-ICxPZDVrBX6kKakLaVCeFR-scn_fbQVbGC5H32XflrLKH87qeIrK06nIQHk0iVUimbUtWefirW2sFWljIyaikE_p_cmgtmUBhBBj6UJFmUliiqeqUpiPP3aJgPEDeN3B-Y3rZZqLcei4TANZJOZEOh14-dFc Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:22:08.439746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_ce6b9eda623740608e0c9998aaa74dab", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 99616b362eac4b7dba445dafd3ca1426 Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:22:08.441731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Cannot 'detach_volume' instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 while it is in vm_state rescued Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'server_id': '3d69ccee-5a6a-4991-9ef2-38f45d65faf2', 'id': 'da6ba4c2-e79d-4f29-89ca-76c25f71df36'} Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:08.442613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 while it is in vm_state rescued Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 while it is in vm_state rescued Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:08.444137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Returning 409 to user: Cannot 'detach_volume' instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 while it is in vm_state rescued {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:08.445460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a3b23299-65f2-43c2-80c0-16a2922c9786 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments/da6ba4c2-e79d-4f29-89ca-76c25f71df36" status: 409 len: 152 microversion: 2.1 time: 0.094872 Aug 02 10:22:08.445460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 353/698] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:22:08 2022] DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments/da6ba4c2-e79d-4f29-89ca-76c25f71df36 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 10:22:08.450344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:08.450876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:08.456814 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.457260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.458063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.458498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.522283 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ecfb75cc-32d2-4224-abab-decc6f8cac9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "POST /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/action" status: 202 len: 0 microversion: 2.1 time: 0.075467 Aug 02 10:22:08.522884 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 346/699] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:22:08 2022] POST /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:22:08.531653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:08.532271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:08.538304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.538756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.540150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:08.540592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:08.714442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:08.722553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a3c2347f-85b8-40d6-9232-de2ed033daee tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1724 microversion: 2.1 time: 0.194726 Aug 02 10:22:08.723132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 354/700] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:08 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:09.745565 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:09.746298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:09.752468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:09.752921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:09.753722 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:09.754184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:09.883901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:09.891763 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6237ccd9-2ca2-48d0-996b-0f8b535cd916 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1724 microversion: 2.1 time: 0.151561 Aug 02 10:22:09.892322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 347/701] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:09 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:10.913354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:10.914505 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:10.920932 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.921377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:10.922162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:10.922594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:11.060768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:11.068937 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-524c59b4-5dbf-43a8-bcea-e3d035eab717 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1724 microversion: 2.1 time: 0.159455 Aug 02 10:22:11.069507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 355/702] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:10 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:12.090461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:12.090996 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:12.097362 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:12.097830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:12.098590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:12.099016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:12.228539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:12.236425 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1c7e5eb5-dc94-4ced-ac14-34a9576ac0bb tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1724 microversion: 2.1 time: 0.149884 Aug 02 10:22:12.236986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 348/703] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:12 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:13.257547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:13.258670 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:13.261098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=39 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:13.266690 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:13.267132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:13.267913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:13.268348 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:13.395200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:13.403575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-fd81cad7-3188-410d-8704-3a24a0a5d360 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1730 microversion: 2.1 time: 0.149848 Aug 02 10:22:13.404135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 356/704] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:13 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:13.424606 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:13.425145 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:13.427570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=39 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:13.434440 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:13.434896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:13.435682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:13.436130 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:13.514167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-963377a1-bd69-4306-8a9d-8b8346ced2af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093246 Aug 02 10:22:13.514763 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 349/705] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:22:13 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:14.696045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-4378fb27-1b51-4fc1-be04-c0875800406c req-07e67f0a-ba66-4a85-b5a4-c484d976f2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d69ccee-5a6a-4991-9ef2-38f45d65faf2", "tag": "d7fdcba9-37a2-4374-96d7-ddbf45910b7a"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:14.705447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-4378fb27-1b51-4fc1-be04-c0875800406c req-07e67f0a-ba66-4a85-b5a4-c484d976f2bc service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:14.705924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-4378fb27-1b51-4fc1-be04-c0875800406c req-07e67f0a-ba66-4a85-b5a4-c484d976f2bc service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:14.718796 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-4378fb27-1b51-4fc1-be04-c0875800406c req-07e67f0a-ba66-4a85-b5a4-c484d976f2bc service nova] Creating event network-changed:d7fdcba9-37a2-4374-96d7-ddbf45910b7a for instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 on hv-cinder-84713 Aug 02 10:22:14.723782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-4378fb27-1b51-4fc1-be04-c0875800406c req-07e67f0a-ba66-4a85-b5a4-c484d976f2bc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101279 Aug 02 10:22:14.724376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 357/706] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:16.740062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-ea90d498-1c85-4d19-9eb2-f0f77c2b4dd7 req-9c8d879f-8b73-4172-a2b7-12282b7e4ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d69ccee-5a6a-4991-9ef2-38f45d65faf2", "tag": "d7fdcba9-37a2-4374-96d7-ddbf45910b7a"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:16.750105 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ea90d498-1c85-4d19-9eb2-f0f77c2b4dd7 req-9c8d879f-8b73-4172-a2b7-12282b7e4ec9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:16.750723 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ea90d498-1c85-4d19-9eb2-f0f77c2b4dd7 req-9c8d879f-8b73-4172-a2b7-12282b7e4ec9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:16.761531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-ea90d498-1c85-4d19-9eb2-f0f77c2b4dd7 req-9c8d879f-8b73-4172-a2b7-12282b7e4ec9 service nova] Creating event network-changed:d7fdcba9-37a2-4374-96d7-ddbf45910b7a for instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 on hv-cinder-84713 Aug 02 10:22:16.766827 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-ea90d498-1c85-4d19-9eb2-f0f77c2b4dd7 req-9c8d879f-8b73-4172-a2b7-12282b7e4ec9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031331 Aug 02 10:22:16.767407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 350/707] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:19.854974 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:19.855563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:19.861773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:19.862363 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:19.863119 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:19.863545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:19.892623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a1240c97-7ba9-44e3-a0aa-00348791ec20 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments/2c92ab5b-1644-4f5c-99fb-59cb0dade2f2" status: 200 len: 194 microversion: 2.20 time: 0.143357 Aug 02 10:22:19.893174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 358/708] 10.222.0.82 () {60 vars in 1454 bytes} [Tue Aug 2 10:22:19 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments/2c92ab5b-1644-4f5c-99fb-59cb0dade2f2 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:22:19.959482 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:19.960061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:19.966179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:19.966629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:19.967399 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:19.967850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:20.092523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lazy-loading 'services' on Instance uuid f67576fd-f413-48a6-b4ca-401e450e7f14 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:22:20.202492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f751440d-519b-4e08-9adb-caaf77ab7f70 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments/2c92ab5b-1644-4f5c-99fb-59cb0dade2f2" status: 202 len: 0 microversion: 2.20 time: 0.247549 Aug 02 10:22:20.203075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 351/709] 10.222.0.82 () {60 vars in 1457 bytes} [Tue Aug 2 10:22:19 2022] DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments/2c92ab5b-1644-4f5c-99fb-59cb0dade2f2 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:22:20.211270 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:20.213451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:20.219482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:20.219942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:20.220707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:20.221138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:20.251739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4880fb5e-1c21-43d7-89d9-79544c735b25 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044307 Aug 02 10:22:20.252311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 359/710] 10.222.0.82 () {60 vars in 1343 bytes} [Tue Aug 2 10:22:20 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:22:21.265830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:21.268122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:21.274948 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.276180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.276944 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.277377 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.308138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-60406895-3d1d-49b1-804d-36253f393555 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047246 Aug 02 10:22:21.308701 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 352/711] 10.222.0.82 () {60 vars in 1343 bytes} [Tue Aug 2 10:22:21 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:21.370102 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:21.370599 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:21.377094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.377547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.378345 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.378783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.404632 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:22:21.484757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b3f3b329-dfb9-4c0d-be18-068babb942f7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 204 len: 0 microversion: 2.20 time: 0.118280 Aug 02 10:22:21.485340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 360/712] 10.222.0.82 () {60 vars in 1280 bytes} [Tue Aug 2 10:22:21 2022] DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:22:21.493504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:21.494204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:21.500746 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.501198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.502016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.502455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.534874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:21.535496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:21.541555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.542033 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.542827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.543265 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.565872 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lazy-loading 'flavor' on Instance uuid c357fc24-f64c-4a36-9daf-18964c425d8e {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:22:21.640036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-fb918021-ac12-431c-94c3-e5c7da041205 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "POST /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.109170 Aug 02 10:22:21.640577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 361/713] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:22:21 2022] POST /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:22:21.643074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:21.648961 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:21.649805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:21.651765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:21.653266 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:21.654562 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4828c202-2941-4e5a-aa47-5566fe49ad5c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.164848 Aug 02 10:22:21.655161 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 353/714] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:21 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:21.665572 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.666097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.666873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:21.667341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:21.798918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:21.806942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7e9e9df6-ade5-4421-bb89-b4460500983c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.161434 Aug 02 10:22:21.807515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 362/715] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:21 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:22.677888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:22.678460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:22.684836 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:22.685294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:22.686090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:22.686534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:22.812859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:22.820966 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:22.822492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:22.823655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-58af73de-9250-4d53-a3e9-14503634a5d2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.149869 Aug 02 10:22:22.824205 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 354/716] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:22 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:22.828184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:22.828805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:22.835077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:22.835496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:22.836347 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:22.836783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:22.974245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:22.981862 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b1acf18b-8d80-471d-bcb0-e5abec0460a4 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.157406 Aug 02 10:22:22.982677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 363/717] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:22 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:23.848674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:23.849503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:23.856777 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:23.857230 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:23.858050 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:23.858488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:24.002592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:24.003233 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:24.010162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:24.010604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:24.011368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:24.011797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:24.015985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:24.178026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:24.185887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:24.187406 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:24.188608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9eba70a5-a69b-48c1-9c22-f7583f3e801f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1725 microversion: 2.20 time: 0.343967 Aug 02 10:22:24.201813 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 355/718] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:23 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:24.293381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:24.300953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-996d95cd-69a3-4595-b1d6-d16194816bec tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.302175 Aug 02 10:22:24.301528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 364/719] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:23 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:24.767928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-ce4e592c-d22e-412d-b59c-2cfbd44b6c18 req-50ee3b9e-af75-4330-90e4-d414a43c7305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67576fd-f413-48a6-b4ca-401e450e7f14", "name": "network-vif-deleted", "tag": "d37cddec-fc79-4a4b-a95d-1e9753dccf29"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:24.779581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ce4e592c-d22e-412d-b59c-2cfbd44b6c18 req-50ee3b9e-af75-4330-90e4-d414a43c7305 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:24.780166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ce4e592c-d22e-412d-b59c-2cfbd44b6c18 req-50ee3b9e-af75-4330-90e4-d414a43c7305 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:24.792561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-ce4e592c-d22e-412d-b59c-2cfbd44b6c18 req-50ee3b9e-af75-4330-90e4-d414a43c7305 service nova] Creating event network-vif-deleted:d37cddec-fc79-4a4b-a95d-1e9753dccf29 for instance f67576fd-f413-48a6-b4ca-401e450e7f14 on hv-cinder-84713 Aug 02 10:22:24.798041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-ce4e592c-d22e-412d-b59c-2cfbd44b6c18 req-50ee3b9e-af75-4330-90e4-d414a43c7305 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035323 Aug 02 10:22:24.799155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 356/720] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:25.212524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:25.213766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:25.220402 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:25.220855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:25.221960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:25.222495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:25.261412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:25.261987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:25.262529 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lazy-loading 'fault' on Instance uuid f67576fd-f413-48a6-b4ca-401e450e7f14 {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:22:25.324461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:25.325392 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:25.334288 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:25.335423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:25.335966 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:25.337204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:25.338584 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:25.344106 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:25.345761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:25.346975 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-07767c88-7bec-434c-b216-0587085b2dbb tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 200 len: 1372 microversion: 2.20 time: 0.138471 Aug 02 10:22:25.348061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 365/721] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:25 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:25.499135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:25.507417 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c5320f0a-d2e7-42b6-8166-caea7526fddf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.188355 Aug 02 10:22:25.508091 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 357/722] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:25 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:26.264563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-391170367"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:26.265170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:26.271674 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.272131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.272904 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.273344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.370064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:26.371155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:26.377441 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.377937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.378708 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.379139 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.392751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] HTTP exception thrown: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Request method failure captured: Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 HTTP/1.1 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pl01lMFi4_uZ6FkAfYb0Q6u9hg8WQmYFOTrmk5nhNI4ec6ZGuswGE_Ipa37kpj17_8D6S9cS3G9OfQIizz6e59xu0Tgb53Izq9WB9RG3-FIlRCBhowdFcXfuw_p50KUJRKnm5l90bqLICdjPfIy992c-gcetUXqNDqu2525dHIF260 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:22:26.394917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_23714720faaa4562b694d7e3fbda2c33", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b6890a8127e04092920cb1d31ab56d91 Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:22:26.396756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'f67576fd-f413-48a6-b4ca-401e450e7f14'} Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:26.398070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:22:26.399324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:22:26.401419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Returning 404 to user: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:26.401419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2b4baa87-f114-4499-beb9-41e0b01200cd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 404 len: 111 microversion: 2.20 time: 0.030222 Aug 02 10:22:26.401419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 358/723] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:26 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:22:26.404135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.network.security_group_api [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Removing security group 961d22f7-5439-4a1c-a409-e0a175acd4ba from port 64a78f08-466d-4e1d-8c12-e3c34f532e6c Aug 02 10:22:26.406192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0547b0be-cfd5-43f3-bbb5-d31c63b1a5be tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '.version_select at 0x7f5c0808d0d0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:26.433312 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0547b0be-cfd5-43f3-bbb5-d31c63b1a5be tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240802145" status: 204 len: 0 microversion: 2.20 time: 0.030672 Aug 02 10:22:26.433998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 359/724] 10.222.0.82 () {60 vars in 1262 bytes} [Tue Aug 2 10:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240802145 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:22:26.528786 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:26.529694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:26.537111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.537933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.539158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.539844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.781075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:26.788495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6b9524bc-f646-4e61-bcfa-ebd7bf130801 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.263752 Aug 02 10:22:26.802145 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 360/725] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:26 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:26.855641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9063ac9a-0087-4691-9d28-4af9440c2752 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/action" status: 202 len: 0 microversion: 2.1 time: 0.595010 Aug 02 10:22:26.857594 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 366/726] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:22:26 2022] POST /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:22:26.869858 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-5341fa6f-ce6d-4aec-97bf-44497c3bf00a req-ad31d331-abc0-4945-8694-8ee239f5fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:26.881313 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-5341fa6f-ce6d-4aec-97bf-44497c3bf00a req-ad31d331-abc0-4945-8694-8ee239f5fb6c service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:26.883588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-5341fa6f-ce6d-4aec-97bf-44497c3bf00a req-ad31d331-abc0-4945-8694-8ee239f5fb6c service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:26.896600 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-5341fa6f-ce6d-4aec-97bf-44497c3bf00a req-ad31d331-abc0-4945-8694-8ee239f5fb6c service nova] Creating event network-changed:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:22:26.902943 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-5341fa6f-ce6d-4aec-97bf-44497c3bf00a req-ad31d331-abc0-4945-8694-8ee239f5fb6c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037879 Aug 02 10:22:26.904138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 361/727] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:27.261125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-92c61834-0071-4bf4-9bbd-ace4f3271af5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'create', calling method: .version_select at 0x7f5c03548790>, body: {"keypair": {"name": "tempest-keypair-753615440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGs28Rfqm4z0NAK1lHtpzJMLJCUkSr9JmOpJl1zDxCja6pj5NaHsjH5cOcb7kSNJmg5iFIss+iYxO73/yzpt038SBmvx4153ObqZYFMegLWRcAT+Ln0ak3JkBK4EHLp/g=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:27.278019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-92c61834-0071-4bf4-9bbd-ace4f3271af5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for project 23714720faaa4562b694d7e3fbda2c33. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:22:27.282122 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-92c61834-0071-4bf4-9bbd-ace4f3271af5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for user b6890a8127e04092920cb1d31ab56d91 and project 23714720faaa4562b694d7e3fbda2c33. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:22:27.310528 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-92c61834-0071-4bf4-9bbd-ace4f3271af5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053225 Aug 02 10:22:27.311437 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 367/728] 10.222.0.82 () {62 vars in 1200 bytes} [Tue Aug 2 10:22:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 10:22:27.813418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:27.814265 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:27.820873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:27.821450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:27.822938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:27.823547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:27.844141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:28.193810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:28.202223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-da9ed4d2-ab90-4d3a-97dd-41f47f5293f5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.393921 Aug 02 10:22:28.202803 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 362/729] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:27 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:28.592917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-312298345", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1aeea0cf-13aa-4672-aaac-8b83f3820caa"}], "security_groups": [{"name": "tempest-securitygroup--1221631982"}], "key_name": "tempest-keypair-753615440", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:28.773221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] validate_networks() for [('1aeea0cf-13aa-4672-aaac-8b83f3820caa', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:22:28.886152 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:28.886741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:28.893524 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:28.894010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:28.894797 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:28.895229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:28.978433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lazy-loading 'services' on Instance uuid 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:22:29.053906 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-11a6ebb7-aef5-44b8-904e-93dfce916eb3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments/d7ac831b-bf35-4631-89f6-ed1822ed3707" status: 202 len: 0 microversion: 2.1 time: 0.174549 Aug 02 10:22:29.054525 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 363/730] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:22:28 2022] DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments/d7ac831b-bf35-4631-89f6-ed1822ed3707 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:22:29.061651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-e4a39ed1-d6d0-484e-8f77-7a998fbbd9e1 req-536c4088-4b29-428b-9814-75d2f6efba03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:29.073893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-e4a39ed1-d6d0-484e-8f77-7a998fbbd9e1 req-536c4088-4b29-428b-9814-75d2f6efba03 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.073893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-e4a39ed1-d6d0-484e-8f77-7a998fbbd9e1 req-536c4088-4b29-428b-9814-75d2f6efba03 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.086558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-e4a39ed1-d6d0-484e-8f77-7a998fbbd9e1 req-536c4088-4b29-428b-9814-75d2f6efba03 service nova] Creating event network-changed:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:22:29.092386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-e4a39ed1-d6d0-484e-8f77-7a998fbbd9e1 req-536c4088-4b29-428b-9814-75d2f6efba03 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035913 Aug 02 10:22:29.092979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 364/731] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:29.099352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:29.103713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:29.111146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.111624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.112370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.113121 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.146125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e17b70c0-a7a1-4629-ab60-15deaef92db5 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051729 Aug 02 10:22:29.146703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 365/732] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:22:29 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:29.226627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:29.227245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:29.233893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.234346 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.235118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.235555 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.381515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:22:29.382690 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:22:29.383283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:22:29.383781 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:22:29.385636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:22:29.396539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.396991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.397815 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:29.398259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:29.412474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:29.417295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for project 23714720faaa4562b694d7e3fbda2c33. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:22:29.420427 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cab3e26a-2919-44d9-a8c9-77bcf150465c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.197467 Aug 02 10:22:29.420998 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 366/733] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:29 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:29.421832 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Getting quotas for user b6890a8127e04092920cb1d31ab56d91 and project 23714720faaa4562b694d7e3fbda2c33. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:22:29.437223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:22:29.439627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:22:29.487376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-143e3f38-5b64-4195-b5ad-ce26b0b69afa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.899968 Aug 02 10:22:29.488809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 368/734] 10.222.0.82 () {62 vars in 1188 bytes} [Tue Aug 2 10:22:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 02 10:22:29.502292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ce1ab2fe-15df-48a4-af11-693b8b65f04d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:29.503442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ce1ab2fe-15df-48a4-af11-693b8b65f04d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:29.560751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ce1ab2fe-15df-48a4-af11-693b8b65f04d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:29.568669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ce1ab2fe-15df-48a4-af11-693b8b65f04d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:29.570495 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ce1ab2fe-15df-48a4-af11-693b8b65f04d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:29.571700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ce1ab2fe-15df-48a4-af11-693b8b65f04d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1280 microversion: 2.20 time: 0.075710 Aug 02 10:22:29.572800 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 367/735] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:29 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:30.158723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:30.161212 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:30.168543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.168995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.169823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.170391 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.203811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-13f9189d-c8a0-4653-aa92-298870a5e043 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049207 Aug 02 10:22:30.204378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 369/736] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:22:30 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:30.442464 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:30.442995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:30.449525 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.450281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.451049 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.451487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.585498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:30.593060 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b6d0f3a5-d7ae-4671-b35c-eaca234fef38 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.154778 Aug 02 10:22:30.593622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 368/737] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:30 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:30.594519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:30.595136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:30.601235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.601686 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.602480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:30.602924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:30.668193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:30.676957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:30.678581 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:30.679698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6856ce18-4378-48c0-bd54-00a5d6620730 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1332 microversion: 2.20 time: 0.089086 Aug 02 10:22:30.680256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 370/738] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:30 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:31.216796 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:31.219090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:31.225588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.226182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.227102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.227587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.256735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0a30e407-55b4-41a9-a4fd-9f7b828d7d39 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044543 Aug 02 10:22:31.257299 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 369/739] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:22:31 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:22:31.268268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:31.268857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:31.276327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.276794 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.277558 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.278028 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.353205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] HTTP exception thrown: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 is not attached to volume d7ac831b-bf35-4631-89f6-ed1822ed3707 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Request method failure captured: Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments/d7ac831b-bf35-4631-89f6-ed1822ed3707 HTTP/1.1 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pm1gZwp6TDox3k7cGeMcqSjT4m2HsKCQH93EGiyXtuCg-snYnodxRfSm_BauGJ_yHAtVqW0DzYjRe-Jh4XbIiAJ6kajQ5bGUmbjNIvgkSCgcSrTPKLvNrtpYEGNRx9mkTad7yTL9vygTpf1YYSaIa8PDzrCt6NvbnTbCMX41n9CloE Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: bdbf0111b2d84f12b205134fde982ae4 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-TestMinimumBasicScenario-1122277354 Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:22:31.359378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdbf0111b2d84f12b205134fde982ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdbf0111b2d84f12b205134fde982ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdbf0111b2d84f12b205134fde982ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdbf0111b2d84f12b205134fde982ae4", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-TestMinimumBasicScenario-1122277354 Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: bdbf0111b2d84f12b205134fde982ae4 Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1122277354 Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-TestMinimumBasicScenario-1122277354-project Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 54bb78d9af854abf845b47f2bb925b74 Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-TestMinimumBasicScenario-1122277354-project Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:22:31.361382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 is not attached to volume d7ac831b-bf35-4631-89f6-ed1822ed3707 Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'server_id': '9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84', 'id': 'd7ac831b-bf35-4631-89f6-ed1822ed3707'} Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d7ac831b-bf35-4631-89f6-ed1822ed3707. Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:31.362201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 is not attached to volume d7ac831b-bf35-4631-89f6-ed1822ed3707 Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 is not attached to volume d7ac831b-bf35-4631-89f6-ed1822ed3707 Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:31.363630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Returning 404 to user: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 is not attached to volume d7ac831b-bf35-4631-89f6-ed1822ed3707 {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:31.365332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2a338e09-80d9-4e01-bc0f-3399808997bb tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments/d7ac831b-bf35-4631-89f6-ed1822ed3707" status: 404 len: 154 microversion: 2.1 time: 0.096725 Aug 02 10:22:31.365332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 371/740] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:22:31 2022] DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84/os-volume_attachments/d7ac831b-bf35-4631-89f6-ed1822ed3707 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:22:31.613875 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:31.614753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:31.622294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.623126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.624146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.625206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.704320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:31.705094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:31.711540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.712117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.713035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:31.713976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:31.941426 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:31.949211 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b4c3a053-1afe-4838-a17b-0e8d0cf369bf tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.339437 Aug 02 10:22:31.950162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 370/741] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:31 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:32.016241 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:32.024450 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:32.026734 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:32.027927 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-87a06226-d945-4805-8e89-dd6bae75b69e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.327757 Aug 02 10:22:32.028482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 372/742] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:31 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:32.305865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-cdd6f474-d35f-43e9-bcd7-22e2f3372c50 req-a8086440-b834-4ff5-b023-ebb0f9ba83e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:32.320220 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-cdd6f474-d35f-43e9-bcd7-22e2f3372c50 req-a8086440-b834-4ff5-b023-ebb0f9ba83e0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.320681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-cdd6f474-d35f-43e9-bcd7-22e2f3372c50 req-a8086440-b834-4ff5-b023-ebb0f9ba83e0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.334822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-cdd6f474-d35f-43e9-bcd7-22e2f3372c50 req-a8086440-b834-4ff5-b023-ebb0f9ba83e0 service nova] Creating event network-changed:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:22:32.341535 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-cdd6f474-d35f-43e9-bcd7-22e2f3372c50 req-a8086440-b834-4ff5-b023-ebb0f9ba83e0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041646 Aug 02 10:22:32.342567 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 371/743] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:32.505348 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:32.506021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:32.512830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.513285 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.514090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.514533 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.540026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:22:32.620256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-24163ec2-3f72-4cb1-b4ff-e541ffbea607 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 204 len: 0 microversion: 2.1 time: 0.117831 Aug 02 10:22:32.621175 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 373/744] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:22:32 2022] DELETE /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:22:32.631324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:32.632033 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:32.639227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.639808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.640607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.641037 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.768488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:32.776092 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a77ccbe9-1f14-4b24-b41f-847cd3ca4645 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1554 microversion: 2.1 time: 0.150001 Aug 02 10:22:32.776650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 372/745] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:32 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:32.971915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:32.972618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:32.979487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.979939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:32.980701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:32.981138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.050694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:33.051412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:33.057491 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:33.058051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.058885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:33.059548 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.144051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:33.152602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-161cc402-6707-4a76-8d86-bdf1ece72ec6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.185361 Aug 02 10:22:33.156158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 374/746] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:32 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:33.206492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:33.214646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:33.216142 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:33.217249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-24900581-f9f2-4b0d-9fda-83509ca1fe63 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.170436 Aug 02 10:22:33.217825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 373/747] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:33 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:33.797258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:33.797814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:33.804388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:33.804839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.805609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:33.806086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:33.931715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:33.939138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4c2148e9-321d-4d28-84d9-7bb488efa3a1 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1554 microversion: 2.1 time: 0.146003 Aug 02 10:22:33.939711 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 375/748] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:33 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:34.176583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:34.177128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:34.183669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.184118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.184879 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.185316 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.240603 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:34.241220 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:34.247529 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.247988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.248780 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.249218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.764133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:34.767382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:34.771833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-abcc328e-747e-4aa0-aebd-82838f1adae0 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.599466 Aug 02 10:22:34.772405 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 374/749] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:34 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:34.775600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:34.777111 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:34.778218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e9b81aab-3a41-4352-bddc-07df550452fe tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.541565 Aug 02 10:22:34.778755 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 376/750] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:34 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:34.960658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:34.961397 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:34.967388 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.967840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:34.968604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:34.969042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.131942 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:35.139360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-933a89ae-0978-4a5f-b549-49614db317f6 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1554 microversion: 2.1 time: 0.182859 Aug 02 10:22:35.139926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 375/751] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:34 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:35.793192 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:35.793862 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:35.800182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:35.800637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.800789 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:35.800915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.801686 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.802150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.807198 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.807650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:35.808404 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:35.808830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.008290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:36.012357 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:36.017170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:36.018687 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:36.019799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7192a0b7-4c30-4bff-aa23-255f23456628 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.223404 Aug 02 10:22:36.020300 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ae1599c7-5ab2-4723-9377-f90c272e37ac tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.231011 Aug 02 10:22:36.020398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 376/752] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:35 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:36.020859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 377/753] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:35 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:36.160324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:36.160868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:36.166819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:36.167290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.168051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:36.168486 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:36.296165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:36.303534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-39734206-1e0c-43c7-b5c2-9eeeee9a2fde tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1554 microversion: 2.1 time: 0.146985 Aug 02 10:22:36.304101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 377/754] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:36 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:37.042351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:37.042896 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:37.043262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:37.043537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:37.049460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:37.049845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:37.049979 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:37.050304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:37.050702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:37.051073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:37.051185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:37.051508 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:37.244104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:37.250813 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:37.251741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-be2cde32-226e-49f4-9cfd-86fe58dbe4a7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.213859 Aug 02 10:22:37.252317 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 378/755] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:37 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:37.259008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:37.261102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:37.262258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b3555eb3-e141-47be-917f-58db3ddcfc80 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.223766 Aug 02 10:22:37.262815 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 378/756] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:37 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:37.331752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:37.332372 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:37.339376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:37.339823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:37.340590 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:37.341026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:37.759489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:37.769000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ac35a7f7-9f17-4f4d-80a4-a69e7d71f02d tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1554 microversion: 2.1 time: 0.441081 Aug 02 10:22:37.769766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 379/757] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:37 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1554 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:38.273108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:38.273768 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:38.280893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.281593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.282569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.283012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.285253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:38.286386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:38.294301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.295186 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.295517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.296129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.676311 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:38.680479 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:38.685218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9eb77e98-05fd-43bd-b4fb-d92f8b7bde89 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.415902 Aug 02 10:22:38.685969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:38.686773 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 379/758] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:38 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:38.691949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-f78dd761-8813-404a-a3f2-4d515358fb6b req-952dcaf8-9a1f-460e-863d-f7486610e814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84", "name": "network-vif-deleted", "tag": "64a78f08-466d-4e1d-8c12-e3c34f532e6c"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:38.694897 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:38.696847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:38.698420 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-38e3f9e2-81bf-41b1-bfdb-1c776b133da1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.416748 Aug 02 10:22:38.699589 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 380/759] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:38 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:38.703099 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-f78dd761-8813-404a-a3f2-4d515358fb6b req-952dcaf8-9a1f-460e-863d-f7486610e814 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.703546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-f78dd761-8813-404a-a3f2-4d515358fb6b req-952dcaf8-9a1f-460e-863d-f7486610e814 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.714766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-f78dd761-8813-404a-a3f2-4d515358fb6b req-952dcaf8-9a1f-460e-863d-f7486610e814 service nova] Creating event network-vif-deleted:64a78f08-466d-4e1d-8c12-e3c34f532e6c for instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 on hv-cinder-84713 Aug 02 10:22:38.719594 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-f78dd761-8813-404a-a3f2-4d515358fb6b req-952dcaf8-9a1f-460e-863d-f7486610e814 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Aug 02 10:22:38.720174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 380/760] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:38.790823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:38.792012 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:38.800805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.801283 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.802146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:38.802615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:38.876777 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:38.884435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f25bf417-fc8f-4c24-9c12-5a8e4e5f36bf tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1512 microversion: 2.1 time: 0.098210 Aug 02 10:22:38.889828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 381/761] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:38 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:39.707463 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:39.711742 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:39.712475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:39.718970 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:39.719423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:39.720195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:39.720375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:39.720783 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:39.721017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:39.723320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:39.724018 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=10 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:39.729585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:39.730211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:39.730912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:39.731351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:39.740844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:39.938157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:39.942268 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:39.946447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:39.948523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:39.949637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2906fbdd-76be-4d23-8adc-884a8be8b52e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.233196 Aug 02 10:22:39.953242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 382/762] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:39 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:39.961863 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d0b47434-e80b-4a0e-b82c-8826f5741641 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.244598 Aug 02 10:22:39.961863 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 381/763] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:39 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:39.962079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:39.962079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:39.962079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:39.962079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:39.962975 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:39.963428 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:40.024430 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bb78d9af854abf845b47f2bb925b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbf0111b2d84f12b205134fde982ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:40.031860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0e80f076-f0b5-4ac3-a465-c7c1dedfb9e3 tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 200 len: 1343 microversion: 2.1 time: 0.080686 Aug 02 10:22:40.032423 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 383/764] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:39 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 1343 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:40.823614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-19a89c10-5635-4a94-8090-091720f55d19 req-e17ebd06-6a39-445d-b20f-1019709a38cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "name": "network-vif-plugged", "status": "completed", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:40.833978 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-19a89c10-5635-4a94-8090-091720f55d19 req-e17ebd06-6a39-445d-b20f-1019709a38cb service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:40.834430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-19a89c10-5635-4a94-8090-091720f55d19 req-e17ebd06-6a39-445d-b20f-1019709a38cb service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:40.845578 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-19a89c10-5635-4a94-8090-091720f55d19 req-e17ebd06-6a39-445d-b20f-1019709a38cb service nova] Creating event network-vif-plugged:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:22:40.855344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-19a89c10-5635-4a94-8090-091720f55d19 req-e17ebd06-6a39-445d-b20f-1019709a38cb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101231 Aug 02 10:22:40.856162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 382/765] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:40.973007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:40.973367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:40.973966 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:40.974856 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:40.981456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:40.982517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:40.983055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:40.983584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:40.983816 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:40.984091 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:40.984937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:40.985677 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:41.222232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:41.230235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-96558f9b-2282-4585-b28d-ea5dab0b3968 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.262231 Aug 02 10:22:41.235735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 384/766] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:40 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:41.236056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:41.242471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:41.244352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:41.246120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-63e12fc7-6251-4461-b88c-35eed455a6bf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.276232 Aug 02 10:22:41.246700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 383/767] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:40 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:41.334966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:41.335588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] [instance: 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:41.342986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:41.343445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:41.344266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:41.344707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:41.515326 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] HTTP exception thrown: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 could not be found. Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Request method failure captured: Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 HTTP/1.1 Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pm1gZwp6TDox3k7cGeMcqSjT4m2HsKCQH93EGiyXtuCg-snYnodxRfSm_BauGJ_yHAtVqW0DzYjRe-Jh4XbIiAJ6kajQ5bGUmbjNIvgkSCgcSrTPKLvNrtpYEGNRx9mkTad7yTL9vygTpf1YYSaIa8PDzrCt6NvbnTbCMX41n9CloE Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: bdbf0111b2d84f12b205134fde982ae4 Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-TestMinimumBasicScenario-1122277354 Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:22:41.517131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdbf0111b2d84f12b205134fde982ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/bdbf0111b2d84f12b205134fde982ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/bdbf0111b2d84f12b205134fde982ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_bdbf0111b2d84f12b205134fde982ae4", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-TestMinimumBasicScenario-1122277354 Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: bdbf0111b2d84f12b205134fde982ae4 Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1122277354 Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-TestMinimumBasicScenario-1122277354-project Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 54bb78d9af854abf845b47f2bb925b74 Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-TestMinimumBasicScenario-1122277354-project Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 could not be found. Aug 02 10:22:41.518736 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84'} Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 could not be found. Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:22:41.519645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 could not be found. Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 could not be found. Aug 02 10:22:41.521057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:22:41.522530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Returning 404 to user: Instance 9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:22:41.522530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9f2ee6b3-a9c9-45a6-aaf3-45e86d1d539f tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84" status: 404 len: 111 microversion: 2.1 time: 0.286759 Aug 02 10:22:41.522530 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 385/768] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:41 2022] GET /compute/v2.1/servers/9d8cf308-cf3e-4f31-b0c2-7c2c4907ce84 => generated 111 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:22:41.527910 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-abadf567-1d9f-47dc-9a56-a49fa05d628b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] Calling method '.version_select at 0x7f5c03754a60>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:41.546675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-abadf567-1d9f-47dc-9a56-a49fa05d628b tempest-TestMinimumBasicScenario-1122277354 tempest-TestMinimumBasicScenario-1122277354-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1446812736" status: 202 len: 0 microversion: 2.1 time: 0.023172 Aug 02 10:22:41.547215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 384/769] 10.222.0.82 () {58 vars in 1272 bytes} [Tue Aug 2 10:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1446812736 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:22:42.252672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:42.253292 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:42.255712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:42.262446 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.262895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.263774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.264212 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.269582 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:42.271048 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:42.277386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.277943 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.278796 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.279300 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.471772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:42.478153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:42.486396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a8c608c4-51d0-4dad-8123-c6cdc87df16e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1510 microversion: 2.1 time: 0.237414 Aug 02 10:22:42.486976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 386/770] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:42 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:42.487240 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:42.488819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:42.490079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-35080f3f-0ac3-49cc-a394-aa8d9fb34ee2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1406 microversion: 2.20 time: 0.225447 Aug 02 10:22:42.490692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 385/771] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:42 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:22:42.507339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:42.507933 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:42.514489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.514942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.515694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.516143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.557966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118032) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 10:22:42.627046 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-02087e6f-420b-49b1-a234-7893e1d4b79d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "POST /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.123538 Aug 02 10:22:42.627901 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 387/772] 10.222.0.82 () {60 vars in 1278 bytes} [Tue Aug 2 10:22:42 2022] POST /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:22:42.642131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:42.642751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:42.648909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.649357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.650165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:42.651170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:42.804725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:42.813395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bde5c010-fb5b-42e9-a8b2-6fea5b079827 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1518 microversion: 2.1 time: 0.175086 Aug 02 10:22:42.814028 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 386/773] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:42 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:43.514000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:43.514618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:43.527883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:43.528478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:43.529478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:43.529924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:43.679361 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:43.688224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:43.690048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:43.691486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ec6d44f8-d665-40c5-9cd0-0401546c316c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1598 microversion: 2.20 time: 0.182778 Aug 02 10:22:43.692422 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 388/774] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:22:43 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:22:43.714469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:43.715042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:43.717357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:43.722524 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:43.722984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:43.723741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:43.724176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:43.814141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2cfc60c5-eee8-4c79-a67c-75494cd44f33 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103515 Aug 02 10:22:43.814735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 387/775] 10.222.0.82 () {60 vars in 1316 bytes} [Tue Aug 2 10:22:43 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:22:43.835194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:43.835893 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:43.842545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:43.843063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:43.844186 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:43.844692 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:44.450966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:44.462839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e2fb000c-f5f9-4a0e-999a-19cfc3fa9373 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1520 microversion: 2.1 time: 0.631562 Aug 02 10:22:44.477822 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 389/776] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:43 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1520 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:44.712378 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-141d9c7b-de99-4068-b75b-7f95f61ff785 req-3a84a46d-d4f7-487b-a611-646c8a42c8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "name": "network-vif-unplugged", "status": "completed", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:44.723164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-141d9c7b-de99-4068-b75b-7f95f61ff785 req-3a84a46d-d4f7-487b-a611-646c8a42c8c1 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:44.723768 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-141d9c7b-de99-4068-b75b-7f95f61ff785 req-3a84a46d-d4f7-487b-a611-646c8a42c8c1 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:44.735481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-141d9c7b-de99-4068-b75b-7f95f61ff785 req-3a84a46d-d4f7-487b-a611-646c8a42c8c1 service nova] Creating event network-vif-unplugged:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:22:44.741005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-141d9c7b-de99-4068-b75b-7f95f61ff785 req-3a84a46d-d4f7-487b-a611-646c8a42c8c1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032377 Aug 02 10:22:44.741981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 388/777] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:45.484985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:45.485651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:45.492164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:45.492611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:45.493461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:45.494064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:45.937817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:45.945447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b93d0931-0857-4d37-a1cc-e5077f5ffe3c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.464274 Aug 02 10:22:45.946051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 390/778] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:45 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:46.618674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-27a7af30-0afb-4560-8c82-25ff8bf38721 req-d363cf87-5537-4e4d-b42d-a0bcca602b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:46.633217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-27a7af30-0afb-4560-8c82-25ff8bf38721 req-d363cf87-5537-4e4d-b42d-a0bcca602b62 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:46.633664 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-27a7af30-0afb-4560-8c82-25ff8bf38721 req-d363cf87-5537-4e4d-b42d-a0bcca602b62 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:46.658589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-27a7af30-0afb-4560-8c82-25ff8bf38721 req-d363cf87-5537-4e4d-b42d-a0bcca602b62 service nova] Creating event network-changed:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:22:46.675664 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-27a7af30-0afb-4560-8c82-25ff8bf38721 req-d363cf87-5537-4e4d-b42d-a0bcca602b62 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060959 Aug 02 10:22:46.677265 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 389/779] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:22:46.967597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:46.968136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:46.974843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:46.975297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:46.976215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:46.976661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:47.134465 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:47.143593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6e2273d8-5e68-4a99-8fd1-ba707e60ad9c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.180276 Aug 02 10:22:47.144611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 391/780] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:46 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:48.166028 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:48.167379 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:48.174346 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:48.174877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:48.175930 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:48.176544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:48.321311 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:48.328785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d4d98526-0752-4912-916e-0c8bbdd6e37d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.167511 Aug 02 10:22:48.329357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 390/781] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:48 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:49.350956 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:49.351798 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:49.358839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:49.359313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:49.360196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:49.360630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:49.500547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:49.511642 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9207cb8d-b5fd-43cc-88a5-f799b95df8f7 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.164087 Aug 02 10:22:49.512630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 392/782] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:49 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:50.533663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:50.534335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:50.542192 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:50.542699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:50.543575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:50.544045 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:50.743365 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:50.751560 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4095e207-24d6-445a-bb44-e1037416ba7c tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.222949 Aug 02 10:22:50.752131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 391/783] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:50 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:51.774150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:51.774879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:51.782064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:51.782511 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:51.783272 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:51.783698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:51.918944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:51.926583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c153206b-3137-4856-aa8c-0c0def74c700 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.156543 Aug 02 10:22:51.927087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 393/784] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:51 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:22:52.949316 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:52.950087 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:52.956645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:52.957097 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:52.958103 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:52.958549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:53.237279 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:53.247493 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-63d5c9a8-b7c6-4b43-b5d3-6be1d9d6ba0a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.301936 Aug 02 10:22:53.248376 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 392/785] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:52 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:54.270599 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:54.271215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:54.279215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:54.279782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:54.280573 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:54.281235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:54.816087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:54.826214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5f2b3c6d-f3a2-4580-8f16-c3a242534af1 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.559213 Aug 02 10:22:54.840621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 394/786] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:54 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:55.847911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:55.849283 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:55.856544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:55.857128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:55.858187 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:55.858694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:56.107189 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:56.116047 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-837e237c-0046-4de9-a397-cb2f6787568d tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.271497 Aug 02 10:22:56.116840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 393/787] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:55 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:57.137972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:57.139247 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:57.146529 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.147330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.147961 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:57.148385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:57.286592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:57.296366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-94ad7574-04a8-4a82-9bb4-c6d05efe74d5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.162195 Aug 02 10:22:57.296945 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 395/788] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:57 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:58.599176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:58.599871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:58.606026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:58.606556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:58.607337 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:58.607779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:58.747829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:22:58.757428 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8ab3a1a7-04fc-4a29-bffb-5dcf8c041efc tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.443130 Aug 02 10:22:58.758865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 394/789] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:58 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:22:59.779470 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:22:59.780881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:22:59.788338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.789057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.794324 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.795560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.832007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-bb965881-cb80-432f-a66d-8cdb14f4f8ce req-cc236513-62a0-4199-aa19-d5b0cf1c6585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "name": "network-vif-plugged", "status": "completed", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:22:59.857845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-bb965881-cb80-432f-a66d-8cdb14f4f8ce req-cc236513-62a0-4199-aa19-d5b0cf1c6585 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:22:59.858499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-bb965881-cb80-432f-a66d-8cdb14f4f8ce req-cc236513-62a0-4199-aa19-d5b0cf1c6585 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:22:59.889148 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-bb965881-cb80-432f-a66d-8cdb14f4f8ce req-cc236513-62a0-4199-aa19-d5b0cf1c6585 service nova] Creating event network-vif-plugged:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:22:59.898671 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-bb965881-cb80-432f-a66d-8cdb14f4f8ce req-cc236513-62a0-4199-aa19-d5b0cf1c6585 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071158 Aug 02 10:22:59.900442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 395/790] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:22:59.995881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:00.004909 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8ebe0310-4cce-41c2-b6c6-e29f02a7299a tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.229397 Aug 02 10:23:00.006278 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 396/791] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:22:59 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:01.028675 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:01.029501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:01.039012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.039622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.043182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:01.044124 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:01.267305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:01.276238 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cb1da5d0-9002-44f3-8fcd-3585266e1169 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.253615 Aug 02 10:23:01.278475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 396/792] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:01 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:02.140606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-104cfb3e-6016-4c48-aa80-05d2becddac2 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Action: 'create', calling method: .version_select at 0x7f5c037154c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2032059013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9Bw6x+VRNBNauyFwnGPkwdgQDLZ8Z2sRLuZtPm7fqrt67OnDoepNOQKy0LXxmej2ptn/ozqThU2ISsaBE5kxUT/XE5O9XpYvWqrhBUmpPiI8v2x0g618LVs9U2rJzThw=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:02.156486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-104cfb3e-6016-4c48-aa80-05d2becddac2 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for project 06660bbc73344c53b5a0337808514df7. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:02.160997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-104cfb3e-6016-4c48-aa80-05d2becddac2 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for user e08bc25f122445f592652671790cc658 and project 06660bbc73344c53b5a0337808514df7. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:02.185000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-104cfb3e-6016-4c48-aa80-05d2becddac2 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.153847 Aug 02 10:23:02.185600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 397/793] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:23:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:02.298953 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:02.300225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:02.307040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.307349 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.308151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:02.308563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:02.530022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:02.540883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b54bcef1-b6a1-4f2d-8ec3-f955b28aa3d8 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1576 microversion: 2.1 time: 0.245763 Aug 02 10:23:02.542271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 397/794] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:02 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:03.563467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:03.564079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:03.572636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.573084 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.573868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.574813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.600704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:03.744566 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:03.752608 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-82852bc8-1762-468e-a96c-2aee8730d791 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1563 microversion: 2.1 time: 0.193047 Aug 02 10:23:03.753170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 398/795] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:03 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:03.974090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:03.976376 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:03.984531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.985005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:03.985826 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:03.986270 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.017778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d8fd628e-4b93-4842-91d9-533115c1dbfb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047622 Aug 02 10:23:04.018673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 398/796] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:23:03 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:23:04.098997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:04.099803 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:04.108272 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.109064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.110114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.110765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.140843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:23:04.238465 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-aff5026a-985c-4744-95bc-70ddd9bbe6ab tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 204 len: 0 microversion: 2.1 time: 0.143071 Aug 02 10:23:04.239871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 399/797] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:23:04 2022] DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:23:04.248883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:04.250191 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:04.256788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.257243 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.258122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:04.258558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:04.414099 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:04.423751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1db7d1f7-e187-47eb-b97e-f778e6d25220 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1671 microversion: 2.1 time: 0.179391 Aug 02 10:23:04.424325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 399/798] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:04 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:05.446738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:05.448719 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:05.458516 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:05.459098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:05.460353 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:05.460807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:05.620289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:05.641531 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-72b982fa-5558-4cd2-a542-e92bc95413dc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1671 microversion: 2.1 time: 0.199902 Aug 02 10:23:05.642149 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 400/799] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:05 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:06.672764 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:06.673540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:06.680690 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:06.681438 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:06.683470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:06.684118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:07.055614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:07.065276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b0894130-6708-47f8-873b-aa3f38b894ca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1605 microversion: 2.1 time: 0.396849 Aug 02 10:23:07.066095 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 400/800] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:06 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1605 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:07.174832 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-14069d5b-2f95-4ecc-ab85-7d58d1be60f6 req-2f9acd2e-7511-42ad-a185-1bc877426416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df694e6a-8f96-4024-9f32-7fd36d7114fe", "name": "network-vif-deleted", "tag": "cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:07.184905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-14069d5b-2f95-4ecc-ab85-7d58d1be60f6 req-2f9acd2e-7511-42ad-a185-1bc877426416 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:07.185552 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-14069d5b-2f95-4ecc-ab85-7d58d1be60f6 req-2f9acd2e-7511-42ad-a185-1bc877426416 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:07.198754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-14069d5b-2f95-4ecc-ab85-7d58d1be60f6 req-2f9acd2e-7511-42ad-a185-1bc877426416 service nova] Creating event network-vif-deleted:cd7317b3-07e5-4e7c-8ca3-22ab5c8fbea6 for instance df694e6a-8f96-4024-9f32-7fd36d7114fe on hv-cinder-84713 Aug 02 10:23:07.204770 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-14069d5b-2f95-4ecc-ab85-7d58d1be60f6 req-2f9acd2e-7511-42ad-a185-1bc877426416 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033454 Aug 02 10:23:07.205452 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 401/801] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:08.086618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:08.087230 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:08.095870 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:08.096322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:08.097134 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:08.097548 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:08.132915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:08.133401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:08.133894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lazy-loading 'fault' on Instance uuid df694e6a-8f96-4024-9f32-7fd36d7114fe {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:23:08.179742 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:08.184518 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:08.190817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-045aa7e8-4cfe-4a17-81a1-02a2dd5b0634 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 200 len: 1327 microversion: 2.1 time: 0.108044 Aug 02 10:23:08.191669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 401/802] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:08 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:09.215123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:09.215750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:09.223110 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.223573 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:09.224526 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:09.225979 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:09.241953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] HTTP exception thrown: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Request method failure captured: Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe HTTP/1.1 Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Plskul8E-ecdVJAX9bWOPxg-W3EYRueI4aM_ewJ-ChG25xsjY8ITlsu3OBbHRxTg0NHZRvrXgDTZkY-DHq0pcjFLa9_UrSVchc3c1eWcdHZd1Vi1yIhRGwvmE7clJRAceV_F-vkcL1DTc2AGjhByqwiaDVyPV8R2BcrAJAgEgv9Dtc Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:23:09.243601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4bc7ee5e1e7f4f5c8d9de8fa1e48991b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: e881ae7c60254c12860fff0a40480641 Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:23:09.245289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'df694e6a-8f96-4024-9f32-7fd36d7114fe'} Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:23:09.246218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:23:09.247702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:09.249261 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Returning 404 to user: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:23:09.249261 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1bf46bc1-9b9d-4111-91ae-300cf061a24d tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 404 len: 111 microversion: 2.1 time: 0.035174 Aug 02 10:23:09.249261 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 402/803] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:09 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:23:09.255305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d9151ba6-c6c0-4372-9159-777bb2139b1a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '.version_select at 0x7f5c03744dc0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:09.274174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d9151ba6-c6c0-4372-9159-777bb2139b1a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619422745" status: 202 len: 0 microversion: 2.1 time: 0.022796 Aug 02 10:23:09.274919 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 402/804] 10.222.0.82 () {58 vars in 1218 bytes} [Tue Aug 2 10:23:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619422745 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:23:09.942193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5662a76a-728a-4ef0-a962-c196ddc73426 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: .version_select at 0x7f5c034e9280>, body: {"keypair": {"name": "tempest-keypair-1683832414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCq+uljicKtIDbko+7A5mac0TQ/aOQUkqTa2ElnItaM2wS0IO+OPr9LXFhW8cbxDmUTW0q9OvDhqnUbG2BOP72nVX5Ti03m/+VothDU0TIyGvs6UQ1ihSzEZq3A6sFIJ9Q=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:09.959026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-5662a76a-728a-4ef0-a962-c196ddc73426 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:09.963034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-5662a76a-728a-4ef0-a962-c196ddc73426 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for user e881ae7c60254c12860fff0a40480641 and project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:09.991367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5662a76a-728a-4ef0-a962-c196ddc73426 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052949 Aug 02 10:23:09.993602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 403/805] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:23:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:11.393256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1869393360", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09afbed8-6c5a-4ce3-a467-c8db3af43e1e"}], "security_groups": [{"name": "tempest-securitygroup--1094427887"}], "key_name": "tempest-keypair-1683832414", "user_data": "}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:11.498581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] validate_networks() for [('09afbed8-6c5a-4ce3-a467-c8db3af43e1e', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:23:11.991744 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:23:11.992195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:23:11.992655 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:23:11.993068 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:23:11.993481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:23:12.002830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:12.003282 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:12.004079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:12.004518 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:12.021601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:12.025578 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Getting quotas for user e881ae7c60254c12860fff0a40480641 and project 4bc7ee5e1e7f4f5c8d9de8fa1e48991b. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:12.036976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:23:12.039411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:23:12.089247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1710b288-786b-4550-9648-5f24892c14d4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700250 Aug 02 10:23:12.090206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 403/806] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:23:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:23:12.102042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4930867a-7dd0-4fd2-9db3-83e269bb2707 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:12.102677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4930867a-7dd0-4fd2-9db3-83e269bb2707 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:12.179112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4930867a-7dd0-4fd2-9db3-83e269bb2707 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:12.186200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4930867a-7dd0-4fd2-9db3-83e269bb2707 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1238 microversion: 2.1 time: 0.088788 Aug 02 10:23:12.186847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 404/807] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:12 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:13.210880 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:13.211798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:13.220391 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.221020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.222147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:13.222760 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:13.330997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:13.343755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1bb107fa-fd6d-44b2-841f-dd2fbb8cbc41 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1298 microversion: 2.1 time: 0.139904 Aug 02 10:23:13.344335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 404/808] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:13 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:14.366648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:14.367502 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:14.369596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:14.377141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:14.377875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:14.378656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:14.379258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:14.570217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:14.577689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-aed181f4-8c88-4e2a-b184-b50430c7fe29 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.215724 Aug 02 10:23:14.578307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 405/809] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:14 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:14.860993 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-70178ff0-4987-40ee-8ddd-4b2ffa40a003 req-cbe5a20f-91c3-434a-aa97-963f83b3a990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c0d9df-9530-461d-a4fe-a4f0f97bb79e", "tag": "4eb6763c-124b-4481-9746-ae7e57107a50"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:14.867148 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:14.877632 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-70178ff0-4987-40ee-8ddd-4b2ffa40a003 req-cbe5a20f-91c3-434a-aa97-963f83b3a990 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:14.878062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-70178ff0-4987-40ee-8ddd-4b2ffa40a003 req-cbe5a20f-91c3-434a-aa97-963f83b3a990 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:14.891868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-70178ff0-4987-40ee-8ddd-4b2ffa40a003 req-cbe5a20f-91c3-434a-aa97-963f83b3a990 service nova] Creating event network-changed:4eb6763c-124b-4481-9746-ae7e57107a50 for instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e on hv-cinder-84713 Aug 02 10:23:14.897210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-70178ff0-4987-40ee-8ddd-4b2ffa40a003 req-cbe5a20f-91c3-434a-aa97-963f83b3a990 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040058 Aug 02 10:23:14.897824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 405/810] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:15.157521 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:15.158124 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:15.164355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.164806 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.165584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.166050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.249643 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lazy-loading 'services' on Instance uuid 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:23:15.332372 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cfd46b3d-cbbd-4cec-9a55-37d360f5db4a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments/da6ba4c2-e79d-4f29-89ca-76c25f71df36" status: 202 len: 0 microversion: 2.1 time: 0.178669 Aug 02 10:23:15.333032 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 406/811] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:23:15 2022] DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments/da6ba4c2-e79d-4f29-89ca-76c25f71df36 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:23:15.342938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:15.345397 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:15.352147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.352429 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.353212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.353651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.389245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6a90f035-a343-48e7-b14b-fb2f620b3cad tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051400 Aug 02 10:23:15.389877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 406/812] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:23:15 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:15.600442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:15.601142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:15.607639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.608093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.608863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:15.609299 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:15.741215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:15.749412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5a315678-642d-43e3-bb7c-d5d70cdff2ea tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.153615 Aug 02 10:23:15.749989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 407/813] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:15 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:16.402456 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:16.404624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:16.411175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.411617 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.412372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.412803 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.441452 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ea7cba7e-4f60-488f-b756-f80ac422bc9f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Aug 02 10:23:16.442048 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 407/814] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:23:16 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:16.769795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:16.770426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:16.777168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.777579 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.778375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:16.778807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:16.908076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:16.915618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-379f7a16-8867-44b8-abd8-fa74d9387e31 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.149700 Aug 02 10:23:16.916177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 408/815] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:16 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:17.454612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:17.456758 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:17.463195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:17.463659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:17.464412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:17.464840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:17.492508 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-10794d73-293d-4b2e-aad4-b8d3f7cc5676 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 Aug 02 10:23:17.493052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 408/816] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:23:17 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:17.936818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:17.937436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:17.945323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:17.945905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:17.946678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:17.947141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.080364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:18.087830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9d4eea10-7514-4108-ac74-4be5ed00a22a tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.154958 Aug 02 10:23:18.088397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 409/817] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:17 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:18.505150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:18.507431 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:18.514017 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.514474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.515237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:18.515673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:18.544051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ad0c07b2-70c0-45f0-9a6d-6b3f7e03b0f2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Aug 02 10:23:18.544600 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 409/818] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:23:18 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:19.109327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.109941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.116496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.116946 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.117720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.118212 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.327224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:19.335214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-86e0b660-c71c-4707-af33-bc5586824e32 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.230291 Aug 02 10:23:19.335832 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 410/819] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:19 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:19.555834 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.558052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.564760 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.565260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.566077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.566520 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.596293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-68206453-e45f-4b50-8218-07f98b331abc tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044508 Aug 02 10:23:19.596865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 410/820] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:23:19 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:23:19.673667 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.674194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.680194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.680652 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.681417 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.681882 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.707738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:23:19.782987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f94e7606-99b4-44b7-b883-fff2ace38537 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 204 len: 0 microversion: 2.1 time: 0.113049 Aug 02 10:23:19.783871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 411/821] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:23:19 2022] DELETE /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:23:19.792075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:19.792711 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:19.799001 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.799455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.800221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:19.800660 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:19.943808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:19.951581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ad926e3d-25b1-4f1a-bded-b35825f7b13b tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1690 microversion: 2.1 time: 0.163648 Aug 02 10:23:19.952153 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 411/822] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:19 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:20.357986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:20.359291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:20.365921 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.366376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:20.367226 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.367664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:20.500814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:20.508223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7d3b553b-1d4c-4055-ade9-fe9ac18047b3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.155103 Aug 02 10:23:20.508783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 412/823] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:20 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:20.972781 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:20.973475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:20.980480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.980933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:20.981706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:20.982241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.112253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.119883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-71aabad6-497c-41c5-9e96-8bb4c3e37045 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1690 microversion: 2.1 time: 0.150985 Aug 02 10:23:21.120460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 412/824] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:20 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:21.529296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:21.529939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:21.536442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.536890 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.537651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.538123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.667354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:21.674900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bcbdd1e3-4032-47a0-863d-473696fea212 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.150116 Aug 02 10:23:21.675472 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 413/825] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:21 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:21.946319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-8bac7525-0485-424b-9dba-cbdf5591d200 req-aa9cd893-18c0-43f8-ae95-337d73615ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c0d9df-9530-461d-a4fe-a4f0f97bb79e", "name": "network-vif-plugged", "status": "completed", "tag": "4eb6763c-124b-4481-9746-ae7e57107a50"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:21.958424 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-8bac7525-0485-424b-9dba-cbdf5591d200 req-aa9cd893-18c0-43f8-ae95-337d73615ff6 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:21.958881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-8bac7525-0485-424b-9dba-cbdf5591d200 req-aa9cd893-18c0-43f8-ae95-337d73615ff6 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:21.969831 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-8bac7525-0485-424b-9dba-cbdf5591d200 req-aa9cd893-18c0-43f8-ae95-337d73615ff6 service nova] Creating event network-vif-plugged:4eb6763c-124b-4481-9746-ae7e57107a50 for instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e on hv-cinder-84713 Aug 02 10:23:21.974912 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-8bac7525-0485-424b-9dba-cbdf5591d200 req-aa9cd893-18c0-43f8-ae95-337d73615ff6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032962 Aug 02 10:23:21.975640 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 413/826] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:22.141654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:22.142300 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:22.148449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.148903 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.149657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.150155 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.154191 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:22.183687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=10 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:22.281003 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.288494 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f56487b0-61bc-42c6-a5ad-3aff4419e3ec tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1690 microversion: 2.1 time: 0.150692 Aug 02 10:23:22.289059 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 414/827] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:22 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:22.693621 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:22.694487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:22.698825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:22.699516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:22.706526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.706969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.707725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:22.708202 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:22.840058 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:22.847308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6d41ff56-f71d-4830-a06b-0cbbea01f432 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.155105 Aug 02 10:23:22.847863 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 414/828] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:22 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:23.310666 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:23.311396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:23.318015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.318469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.319284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.319989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.482148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:23.489742 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ad0037da-eb17-48bb-9c75-e2615eb298b5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1690 microversion: 2.1 time: 0.183526 Aug 02 10:23:23.490323 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 415/829] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:23 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:23.868484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:23.869097 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:23.876275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.876720 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:23.877482 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:23.877942 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.008066 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:24.015393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6e627ec2-2913-4d76-a891-39f66f92a123 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.150802 Aug 02 10:23:24.015952 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 415/830] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:23 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:24.510787 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:24.511441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:24.518043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:24.518501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.519394 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:24.519841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:24.653867 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:24.661405 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c79e7019-187c-493e-883d-5da4c38248e5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1690 microversion: 2.1 time: 0.154492 Aug 02 10:23:24.662066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 416/831] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:24 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:25.036420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:25.037040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:25.044275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.044733 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.045498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.045982 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.282221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:25.289670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-130397b5-1537-4348-b0e1-e00ef91108b7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1364 microversion: 2.1 time: 0.257045 Aug 02 10:23:25.290201 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 416/832] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:25 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:25.683378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:25.683997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:25.691115 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.691571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:25.692361 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:25.692808 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.001548 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.010134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5532cdaa-57ac-486f-a1c6-5caaafa4c24f tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 200 len: 1690 microversion: 2.1 time: 0.330688 Aug 02 10:23:26.011200 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 417/833] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:25 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 1690 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:26.311484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:26.312062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:26.319101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.320074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.320946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.321462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.341529 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-c4345eeb-5377-4455-ac5d-13af6648d630 req-cf9bcb0f-e21a-4ced-8cb3-b501e8344ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d69ccee-5a6a-4991-9ef2-38f45d65faf2", "name": "network-vif-deleted", "tag": "d7fdcba9-37a2-4374-96d7-ddbf45910b7a"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:26.353822 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-c4345eeb-5377-4455-ac5d-13af6648d630 req-cf9bcb0f-e21a-4ced-8cb3-b501e8344ea2 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.354655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-c4345eeb-5377-4455-ac5d-13af6648d630 req-cf9bcb0f-e21a-4ced-8cb3-b501e8344ea2 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.367058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-c4345eeb-5377-4455-ac5d-13af6648d630 req-cf9bcb0f-e21a-4ced-8cb3-b501e8344ea2 service nova] Creating event network-vif-deleted:d7fdcba9-37a2-4374-96d7-ddbf45910b7a for instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 on hv-cinder-84713 Aug 02 10:23:26.376387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-c4345eeb-5377-4455-ac5d-13af6648d630 req-cf9bcb0f-e21a-4ced-8cb3-b501e8344ea2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038985 Aug 02 10:23:26.377292 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 418/834] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:23:26.483126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:26.491278 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-71fa3610-ade7-401e-aef2-b86051de7eca tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1549 microversion: 2.1 time: 0.184490 Aug 02 10:23:26.493854 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 417/835] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:26 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:26.515218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:26.516056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:26.523346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.523798 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.524916 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:26.525519 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:26.615616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c7d46a68-71f1-47a0-80b1-c56bb67dcba8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105130 Aug 02 10:23:26.616285 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 419/836] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:23:26 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:27.036644 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:27.037837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 3d69ccee-5a6a-4991-9ef2-38f45d65faf2] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:27.047015 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.047953 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.048924 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.049519 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.066338 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] HTTP exception thrown: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 could not be found. Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Request method failure captured: Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 HTTP/1.1 Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pl4Qg1fbk9Q6IAsiK-ICxPZDVrBX6kKakLaVCeFR-scn_fbQVbGC5H32XflrLKH87qeIrK06nIQHk0iVUimbUtWefirW2sFWljIyaikE_p_cmgtmUBhBBj6UJFmUliiqeqUpiPP3aJgPEDeN3B-Y3rZZqLcei4TANZJOZEOh14-dFc Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:23:27.068273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_ce6b9eda623740608e0c9998aaa74dab", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 99616b362eac4b7dba445dafd3ca1426 Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 could not be found. Aug 02 10:23:27.070135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '3d69ccee-5a6a-4991-9ef2-38f45d65faf2'} Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 could not be found. Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:23:27.071258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 could not be found. Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 could not be found. Aug 02 10:23:27.073182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:27.076013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Returning 404 to user: Instance 3d69ccee-5a6a-4991-9ef2-38f45d65faf2 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:23:27.076887 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-83093b33-2be2-4c81-a096-8b4cd4bffc97 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2" status: 404 len: 111 microversion: 2.1 time: 0.047598 Aug 02 10:23:27.077457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 418/837] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:27 2022] GET /compute/v2.1/servers/3d69ccee-5a6a-4991-9ef2-38f45d65faf2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:23:27.086422 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-94759123-84f3-4467-82ee-cd84509629bf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '.version_select at 0x7f5c03517160>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:27.109696 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-94759123-84f3-4467-82ee-cd84509629bf tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522555255" status: 202 len: 0 microversion: 2.1 time: 0.027534 Aug 02 10:23:27.110355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 420/838] 10.222.0.82 () {58 vars in 1221 bytes} [Tue Aug 2 10:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522555255 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:23:27.908450 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-3353d195-6b42-4430-bab1-fc9dce472a26 req-93460dc6-34a5-43b0-868b-6daba426c43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c0d9df-9530-461d-a4fe-a4f0f97bb79e", "tag": "4eb6763c-124b-4481-9746-ae7e57107a50"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:27.916824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3353d195-6b42-4430-bab1-fc9dce472a26 req-93460dc6-34a5-43b0-868b-6daba426c43a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:27.917324 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3353d195-6b42-4430-bab1-fc9dce472a26 req-93460dc6-34a5-43b0-868b-6daba426c43a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:27.929255 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-3353d195-6b42-4430-bab1-fc9dce472a26 req-93460dc6-34a5-43b0-868b-6daba426c43a service nova] Creating event network-changed:4eb6763c-124b-4481-9746-ae7e57107a50 for instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e on hv-cinder-84713 Aug 02 10:23:27.936459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-3353d195-6b42-4430-bab1-fc9dce472a26 req-93460dc6-34a5-43b0-868b-6daba426c43a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102567 Aug 02 10:23:27.937435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 419/839] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:28.099338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836173858", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2032059013", "security_groups": [{"name": "tempest-secgroup-smoke-49774062"}], "block_device_mapping_v2": [{"uuid": "1e9b005e-ee7e-4dc2-bdbb-8e51b08b1787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "535ee2bd-f985-461e-abca-68d048d5ab67"}]}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:28.293690 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] validate_networks() for [('535ee2bd-f985-461e-abca-68d048d5ab67', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:23:28.864889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:23:28.865316 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:23:28.865813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:23:28.866282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:23:28.866701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:23:28.881936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:28.882527 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:28.883412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:28.883923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:28.902310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for project 06660bbc73344c53b5a0337808514df7. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:28.906419 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for user e08bc25f122445f592652671790cc658 and project 06660bbc73344c53b5a0337808514df7. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:28.966705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:23:28.968779 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e9b005e-ee7e-4dc2-bdbb-8e51b08b1787',volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:23:29.110626 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-84642dbc-01e4-488b-acea-0b2d4d7f70f8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.016789 Aug 02 10:23:29.111327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 421/840] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:23:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 10:23:29.122926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8009ad20-a3cb-4180-b565-1104b4655567 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:29.123623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8009ad20-a3cb-4180-b565-1104b4655567 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:29.180562 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8009ad20-a3cb-4180-b565-1104b4655567 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:29.187907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8009ad20-a3cb-4180-b565-1104b4655567 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1095 microversion: 2.1 time: 0.069549 Aug 02 10:23:29.188496 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 420/841] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:29 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:30.094690 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:30.095290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:30.101978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.102583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.103337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.103775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.131232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:23:30.212223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:30.213549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:30.217107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1ffbc524-3ddc-415c-a7d9-12d9beec3596 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 204 len: 0 microversion: 2.1 time: 0.124981 Aug 02 10:23:30.218664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 422/842] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:23:30 2022] DELETE /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:23:30.228833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:30.230346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:30.238654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.239116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.239483 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.239634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.240513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.241315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:30.243830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:30.358949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.366615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-56d83250-0525-424d-9d53-48e6d0497043 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1211 microversion: 2.1 time: 0.161510 Aug 02 10:23:30.367180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 421/843] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:30 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:30.416869 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:30.424657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-77f87068-7ae1-42af-9cdf-f3f27e7b33b7 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1508 microversion: 2.1 time: 0.200769 Aug 02 10:23:30.425212 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 423/844] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:30 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:31.388157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:31.388780 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:31.395453 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.395902 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.396702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.397170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.447570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:31.449675 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:31.457065 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.457523 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.458341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:31.458784 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:31.731435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:31.739036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-aaf8429f-8f1f-4dd7-b1ef-1333304140bf tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1277 microversion: 2.1 time: 0.355133 Aug 02 10:23:31.739610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 422/845] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:31 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1277 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:31.834438 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:31.843047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a014e314-1240-449d-ad2a-9762c34d68af tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1508 microversion: 2.1 time: 0.401005 Aug 02 10:23:31.843628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 424/846] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:31 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:32.750602 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-ed3c0742-701c-478d-ab26-41700e6c77b7 req-475bc165-af8d-42b7-8372-4ff14fbe4a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5864b784-67b0-4103-b4ca-1fa50804e269", "name": "network-vif-deleted", "tag": "2e6932a7-2bdf-48ce-9599-52404dd3c01d"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:32.763966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:32.765950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:32.773982 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ed3c0742-701c-478d-ab26-41700e6c77b7 req-475bc165-af8d-42b7-8372-4ff14fbe4a49 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.774527 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ed3c0742-701c-478d-ab26-41700e6c77b7 req-475bc165-af8d-42b7-8372-4ff14fbe4a49 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.780305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.781198 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.782483 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.783126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.788257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-ed3c0742-701c-478d-ab26-41700e6c77b7 req-475bc165-af8d-42b7-8372-4ff14fbe4a49 service nova] Creating event network-vif-deleted:2e6932a7-2bdf-48ce-9599-52404dd3c01d for instance 5864b784-67b0-4103-b4ca-1fa50804e269 on hv-cinder-84713 Aug 02 10:23:32.794872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-ed3c0742-701c-478d-ab26-41700e6c77b7 req-475bc165-af8d-42b7-8372-4ff14fbe4a49 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048054 Aug 02 10:23:32.795809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 423/847] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:32.868287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:32.868932 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:32.881006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.881489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.882325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.882958 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.902305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=100 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:32.916276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:32.916702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:32.918132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lazy-loading 'fault' on Instance uuid 5864b784-67b0-4103-b4ca-1fa50804e269 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:23:32.994719 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.002736 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6a3db59c-32d4-4d8a-a089-3795fc2fb98a tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 200 len: 1312 microversion: 2.1 time: 0.141733 Aug 02 10:23:33.003325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 424/848] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:32 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:33.038377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:33.046771 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1f9c4f6d-85d1-4498-897c-fde446bbacd7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.289902 Aug 02 10:23:33.047347 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 425/849] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:32 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:34.035222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:34.035810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 5864b784-67b0-4103-b4ca-1fa50804e269] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:34.042952 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.043341 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.044100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.044531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.057300 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] HTTP exception thrown: Instance 5864b784-67b0-4103-b4ca-1fa50804e269 could not be found. Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Request method failure captured: Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 HTTP/1.1 Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pl4Qg1fbk9Q6IAsiK-ICxPZDVrBX6kKakLaVCeFR-scn_fbQVbGC5H32XflrLKH87qeIrK06nIQHk0iVUimbUtWefirW2sFWljIyaikE_p_cmgtmUBhBBj6UJFmUliiqeqUpiPP3aJgPEDeN3B-Y3rZZqLcei4TANZJOZEOh14-dFc Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:23:34.058925 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_ce6b9eda623740608e0c9998aaa74dab", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 99616b362eac4b7dba445dafd3ca1426 Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 5864b784-67b0-4103-b4ca-1fa50804e269 could not be found. Aug 02 10:23:34.063928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '5864b784-67b0-4103-b4ca-1fa50804e269'} Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5864b784-67b0-4103-b4ca-1fa50804e269 could not be found. Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:23:34.064876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5864b784-67b0-4103-b4ca-1fa50804e269 could not be found. Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5864b784-67b0-4103-b4ca-1fa50804e269 could not be found. Aug 02 10:23:34.066637 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:23:34.067984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Returning 404 to user: Instance 5864b784-67b0-4103-b4ca-1fa50804e269 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:23:34.067984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f98e55c8-51ff-4c8e-ae2f-3473e795081d tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269" status: 404 len: 111 microversion: 2.1 time: 0.028923 Aug 02 10:23:34.067984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 425/850] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:34 2022] GET /compute/v2.1/servers/5864b784-67b0-4103-b4ca-1fa50804e269 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:23:34.068232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:34.068754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:34.068931 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:34.069221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:34.075771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.076215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.076539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.076983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.077235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.077474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.077741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.078216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.102581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:23:34.179123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ca5112f8-af4e-4e35-88c5-f98c741ad696 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 204 len: 0 microversion: 2.1 time: 0.113789 Aug 02 10:23:34.179709 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 426/851] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:23:34 2022] DELETE /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:23:34.188064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:34.188792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:34.194695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.195406 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.196178 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.196620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.216307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:34.223712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9fff0ae4-0730-4370-8524-069694c2186f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.159922 Aug 02 10:23:34.224282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 426/852] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:34 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:34.327286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:34.334704 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c22dc1cd-672f-4fc8-86d1-c7ec2b569706 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.150690 Aug 02 10:23:34.335259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 427/853] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:34 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:34.811779 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-8e930ecd-7121-4fbd-88b0-87731c536b9d req-29f3b1f7-1f49-4572-9338-8fdeb025e221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca275f46-5c0d-4492-8ba8-e0b65fcc42ba", "tag": "665de422-edc2-4047-ac40-261bdd033d67"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:34.821423 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-8e930ecd-7121-4fbd-88b0-87731c536b9d req-29f3b1f7-1f49-4572-9338-8fdeb025e221 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:34.822020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-8e930ecd-7121-4fbd-88b0-87731c536b9d req-29f3b1f7-1f49-4572-9338-8fdeb025e221 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:34.833259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-8e930ecd-7121-4fbd-88b0-87731c536b9d req-29f3b1f7-1f49-4572-9338-8fdeb025e221 service nova] Creating event network-changed:665de422-edc2-4047-ac40-261bdd033d67 for instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba on hv-cinder-84713 Aug 02 10:23:34.838157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-8e930ecd-7121-4fbd-88b0-87731c536b9d req-29f3b1f7-1f49-4572-9338-8fdeb025e221 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030658 Aug 02 10:23:34.838739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 427/854] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:35.244920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:35.246126 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:35.252767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:35.253219 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:35.254097 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:35.254536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:35.357256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:35.357986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:35.364651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:35.365101 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:35.365903 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:35.366340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:35.389247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:35.396765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2ffe8425-5d1f-4053-a83f-4c4acf4f4a2d tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.155961 Aug 02 10:23:35.397337 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 428/855] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:35 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:35.497797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:35.505689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1027f5fc-cd27-4cf5-bee6-af5a249b6ea0 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.153238 Aug 02 10:23:35.506282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 428/856] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:35 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:36.417936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:36.418561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:36.425089 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.425536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.426335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.427079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.526490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:36.527934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:36.534684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.535138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.535913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:36.536350 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:36.563625 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.571501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ec7972a1-8b80-4b09-a738-485001a59e1f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.157510 Aug 02 10:23:36.572074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 429/857] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:36 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:36.664499 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:36.673364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e4efc89a-0fe1-4d1b-b0dc-3f2c7dc5cec5 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.150888 Aug 02 10:23:36.673951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 429/858] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:36 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:37.592528 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:37.593135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:37.599651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.600101 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.600868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.601308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.694964 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:37.695948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:37.703071 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.703526 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.704310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:37.704753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:37.735689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:37.743119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-74004ad1-fe11-4d83-83e3-a2f40a29a75c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.154391 Aug 02 10:23:37.743680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 430/859] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:37 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:37.832731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:37.840205 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4a66b1fc-62af-4c11-844a-3daf8186f4be tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1521 microversion: 2.1 time: 0.149247 Aug 02 10:23:37.840769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 430/860] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:37 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:38.766361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:38.767669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:38.775174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.775698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.776561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.777761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.787464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-c45d6549-f734-43a4-b74c-fe7c25f7d4ac req-2893e06d-88f0-4d92-8df2-da6cae04db01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df5b287-bdb5-44e4-bbca-22bf77e34aad", "name": "network-vif-deleted", "tag": "382c2947-ee5b-42e3-a51b-67d45f507974"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:38.798141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-c45d6549-f734-43a4-b74c-fe7c25f7d4ac req-2893e06d-88f0-4d92-8df2-da6cae04db01 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.798621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-c45d6549-f734-43a4-b74c-fe7c25f7d4ac req-2893e06d-88f0-4d92-8df2-da6cae04db01 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.810069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-c45d6549-f734-43a4-b74c-fe7c25f7d4ac req-2893e06d-88f0-4d92-8df2-da6cae04db01 service nova] Creating event network-vif-deleted:382c2947-ee5b-42e3-a51b-67d45f507974 for instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad on hv-cinder-84713 Aug 02 10:23:38.815459 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-c45d6549-f734-43a4-b74c-fe7c25f7d4ac req-2893e06d-88f0-4d92-8df2-da6cae04db01 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031592 Aug 02 10:23:38.816321 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 431/861] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:23:38.861185 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:38.861925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:38.868812 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.869272 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.870077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:38.870804 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:38.891623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:38.915501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:38.934670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:38.942396 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1afd0ec1-cf48-4d92-bf1c-be26b8f43bbc tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.180015 Aug 02 10:23:38.942978 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 431/862] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:38 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:38.956952 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99616b362eac4b7dba445dafd3ca1426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6b9eda623740608e0c9998aaa74dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:38.966038 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-520468eb-af8e-4c88-b0bc-638783e8cb54 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 200 len: 1307 microversion: 2.1 time: 0.108917 Aug 02 10:23:38.966624 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 432/863] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:38 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:39.963105 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:39.963811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:39.967328 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:39.972160 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.972695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.973480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.973959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.987480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:39.988256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] [instance: 1df5b287-bdb5-44e4-bbca-22bf77e34aad] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:39.995061 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.995771 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:39.996778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:39.997390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:40.001758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:40.013125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] HTTP exception thrown: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad could not be found. Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Request method failure captured: Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad HTTP/1.1 Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pl4Qg1fbk9Q6IAsiK-ICxPZDVrBX6kKakLaVCeFR-scn_fbQVbGC5H32XflrLKH87qeIrK06nIQHk0iVUimbUtWefirW2sFWljIyaikE_p_cmgtmUBhBBj6UJFmUliiqeqUpiPP3aJgPEDeN3B-Y3rZZqLcei4TANZJOZEOh14-dFc Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:23:40.014864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ce6b9eda623740608e0c9998aaa74dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_ce6b9eda623740608e0c9998aaa74dab", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: ce6b9eda623740608e0c9998aaa74dab Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2130729992 Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 99616b362eac4b7dba445dafd3ca1426 Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2130729992-project Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad could not be found. Aug 02 10:23:40.016286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '1df5b287-bdb5-44e4-bbca-22bf77e34aad'} Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad could not be found. Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:23:40.017048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad could not be found. Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad could not be found. Aug 02 10:23:40.018304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:23:40.021261 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] Returning 404 to user: Instance 1df5b287-bdb5-44e4-bbca-22bf77e34aad could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:23:40.022537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4839b3a4-8d3b-4e6c-acf3-336545c74ad2 tempest-ServerRescueNegativeTestJSON-2130729992 tempest-ServerRescueNegativeTestJSON-2130729992-project] 10.222.0.82 "GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad" status: 404 len: 111 microversion: 2.1 time: 0.038659 Aug 02 10:23:40.023362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 433/864] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:39 2022] GET /compute/v2.1/servers/1df5b287-bdb5-44e4-bbca-22bf77e34aad => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:23:40.118050 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:40.127293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8ab840d1-2789-4376-ad0a-63d076fe6d9f tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.168005 Aug 02 10:23:40.127938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 432/865] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:39 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:41.148569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:41.149218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:41.156990 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.157447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.158257 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:41.158693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:41.291494 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:41.298943 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2a6aff98-46e0-4cb0-8976-80cd3985bf41 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.154366 Aug 02 10:23:41.299509 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 434/866] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:41 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:42.044115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-3670370a-3add-484c-9ae7-00718559ab2b req-5fc54a4c-6d7d-49b0-aa99-faa4a33d62b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca275f46-5c0d-4492-8ba8-e0b65fcc42ba", "name": "network-vif-plugged", "status": "completed", "tag": "665de422-edc2-4047-ac40-261bdd033d67"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:42.055977 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3670370a-3add-484c-9ae7-00718559ab2b req-5fc54a4c-6d7d-49b0-aa99-faa4a33d62b0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.056616 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3670370a-3add-484c-9ae7-00718559ab2b req-5fc54a4c-6d7d-49b0-aa99-faa4a33d62b0 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.069539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-3670370a-3add-484c-9ae7-00718559ab2b req-5fc54a4c-6d7d-49b0-aa99-faa4a33d62b0 service nova] Creating event network-vif-plugged:665de422-edc2-4047-ac40-261bdd033d67 for instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba on hv-cinder-84713 Aug 02 10:23:42.075259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-3670370a-3add-484c-9ae7-00718559ab2b req-5fc54a4c-6d7d-49b0-aa99-faa4a33d62b0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Aug 02 10:23:42.076543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 433/867] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:42.319695 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:42.320309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:42.328985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.329420 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.330225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:42.330664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:42.516735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:42.525249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-42418e3f-3bf9-440a-a054-f1664959efe7 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.209265 Aug 02 10:23:42.526103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 435/868] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:42 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:43.547498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:43.548183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:43.554775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:43.555166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:43.555947 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:43.556391 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:43.703468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:43.711460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-edf02fe4-15e2-4753-bb12-eefddd3fa5ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1265 microversion: 2.1 time: 0.168749 Aug 02 10:23:43.712035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 434/869] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:43 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:44.735811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:44.736900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:44.738992 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:44.744311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.744917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.745801 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.746534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.893740 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:44.901545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8b9d090b-679c-448a-9c5f-c7da506864b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1453 microversion: 2.1 time: 0.169991 Aug 02 10:23:44.902279 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 436/870] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:44 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:44.922341 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:44.923040 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:44.925454 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:44.930659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.931103 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:44.932056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:44.932658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:45.114999 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:45.123619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a2d1070e-647e-48aa-9743-792592f0f0fe tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1453 microversion: 2.1 time: 0.205629 Aug 02 10:23:45.124334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 435/871] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:44 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:47.157938 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-32951b62-45fc-434b-ac96-4edd2ef10909 req-9c3088d9-c706-4c65-8281-b00f8cffb0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca275f46-5c0d-4492-8ba8-e0b65fcc42ba", "tag": "665de422-edc2-4047-ac40-261bdd033d67"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:47.170242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-32951b62-45fc-434b-ac96-4edd2ef10909 req-9c3088d9-c706-4c65-8281-b00f8cffb0de service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:47.171002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-32951b62-45fc-434b-ac96-4edd2ef10909 req-9c3088d9-c706-4c65-8281-b00f8cffb0de service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:47.184013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-32951b62-45fc-434b-ac96-4edd2ef10909 req-9c3088d9-c706-4c65-8281-b00f8cffb0de service nova] Creating event network-changed:665de422-edc2-4047-ac40-261bdd033d67 for instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba on hv-cinder-84713 Aug 02 10:23:47.189404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-32951b62-45fc-434b-ac96-4edd2ef10909 req-9c3088d9-c706-4c65-8281-b00f8cffb0de service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035062 Aug 02 10:23:47.194255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 437/872] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:49.465247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cbeafeb7-1a99-4588-8ec5-bddfdcf86e15 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: .version_select at 0x7f5c0363d310>, body: {"keypair": {"name": "tempest-keypair-885852708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISfK+zjQXs7h1S0t0lRgGy/GBFXRM7sA8Sfx+5ZiJbGgI5bZA0nNJ3DxMvjTBciELqr/ijh6j7t/En7oiTZDwMwy46aIArft4S6uUR36SSfIhL1YgbrxoXU0AZ5nFxTdw=="}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:49.481259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-cbeafeb7-1a99-4588-8ec5-bddfdcf86e15 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:49.485069 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-cbeafeb7-1a99-4588-8ec5-bddfdcf86e15 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:49.506335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cbeafeb7-1a99-4588-8ec5-bddfdcf86e15 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163313 Aug 02 10:23:49.506929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 436/873] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:23:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:50.997578 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-579202610", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c06faac-b7f7-48ef-b76d-6bd0b909a62b"}], "security_groups": [{"name": "tempest-securitygroup--1654618819"}], "key_name": "tempest-keypair-885852708", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:51.108557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] validate_networks() for [('7c06faac-b7f7-48ef-b76d-6bd0b909a62b', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:23:51.508954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:23:51.509377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:23:51.509870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:23:51.510476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:23:51.510889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:23:51.520359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.520812 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.521665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:51.522141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:51.539794 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:23:51.544392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:23:51.555701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:23:51.558112 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:23:51.605726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-31102413-8c06-4c7d-9c5f-fac57b554b2c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.617423 Aug 02 10:23:51.606524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 438/874] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:23:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:23:51.617957 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a58e995f-40b2-4921-9aa0-efafdf671ee0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:51.618570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a58e995f-40b2-4921-9aa0-efafdf671ee0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:51.690110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a58e995f-40b2-4921-9aa0-efafdf671ee0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:51.699348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a58e995f-40b2-4921-9aa0-efafdf671ee0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1240 microversion: 2.1 time: 0.085559 Aug 02 10:23:51.700393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 437/875] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:51 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:52.720405 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:52.722513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:52.733030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:52.733774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:52.734817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:52.735498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:52.829732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:52.842583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8c525889-5b83-476a-9563-62a216efae6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1310 microversion: 2.1 time: 0.125414 Aug 02 10:23:52.856170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 439/876] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:52 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:53.864459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:53.865094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:53.872348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:53.872794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:53.873623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:53.874093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.083604 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:54.091395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-76a5dd5e-e2b0-4861-8f3b-00cda01a1c55 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.230790 Aug 02 10:23:54.091952 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 438/877] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:53 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:23:54.345180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-e75c9ebe-74e8-414d-9ed2-4eb4264ad773 req-23e19d3d-45fc-48d0-8733-8e603e8b9138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023bb92-5fed-496c-a500-1d424eb6621d", "tag": "165dd833-be3f-4680-b710-242e36dcdfa1"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:23:54.356957 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-e75c9ebe-74e8-414d-9ed2-4eb4264ad773 req-23e19d3d-45fc-48d0-8733-8e603e8b9138 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:54.357393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-e75c9ebe-74e8-414d-9ed2-4eb4264ad773 req-23e19d3d-45fc-48d0-8733-8e603e8b9138 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:54.369972 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-e75c9ebe-74e8-414d-9ed2-4eb4264ad773 req-23e19d3d-45fc-48d0-8733-8e603e8b9138 service nova] Creating event network-changed:165dd833-be3f-4680-b710-242e36dcdfa1 for instance e023bb92-5fed-496c-a500-1d424eb6621d on hv-cinder-84713 Aug 02 10:23:54.382702 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-e75c9ebe-74e8-414d-9ed2-4eb4264ad773 req-23e19d3d-45fc-48d0-8733-8e603e8b9138 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043170 Aug 02 10:23:54.387497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 440/878] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:23:55.111646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:55.112287 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:55.118693 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:55.119133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:55.119913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:55.120343 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:55.251693 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:55.259134 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9529a440-2e9f-4337-b768-a7457f59953c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.151295 Aug 02 10:23:55.259692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 439/879] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:55 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:56.280461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:56.281340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:56.292524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.293398 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.294828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:56.295644 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:56.437863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:56.445274 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-10274509-f001-49bd-ac89-1b25aa416619 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.169112 Aug 02 10:23:56.445851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 441/880] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:56 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:57.466772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:57.467394 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:57.473419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:57.473899 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.474661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:57.475087 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:57.684846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:57.692736 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7111301c-2c54-4544-8b2a-2537a8953e56 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.230402 Aug 02 10:23:57.693298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 440/881] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:57 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:58.713458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:58.714036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:58.720764 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.721219 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.722023 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:58.722471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:58.852049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:23:58.859651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b8b8354f-c440-4210-8674-a966fb527e60 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.150161 Aug 02 10:23:58.860209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 442/882] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:58 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:23:59.880866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:23:59.881504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:23:59.887980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.888432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:23:59.889195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:23:59.889629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:00.019286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:00.026717 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-26acc29a-3785-4c27-9b99-8938e45cadeb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.149732 Aug 02 10:24:00.027808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 441/883] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:23:59 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:01.048291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:01.048917 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:01.055517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:01.055973 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:01.056800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:01.057255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:01.191315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:01.199084 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c9fa0758-429d-412c-8503-323dc3289442 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.154790 Aug 02 10:24:01.199660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 443/884] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:01 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:02.138810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-1c40b11c-609a-453c-abd9-1c7d59aaa8a1 req-178c1a46-20a2-42a0-a17d-cdde046cd7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e023bb92-5fed-496c-a500-1d424eb6621d", "name": "network-vif-plugged", "status": "completed", "tag": "165dd833-be3f-4680-b710-242e36dcdfa1"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:02.143890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:02.149994 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-1c40b11c-609a-453c-abd9-1c7d59aaa8a1 req-178c1a46-20a2-42a0-a17d-cdde046cd7f5 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.150435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-1c40b11c-609a-453c-abd9-1c7d59aaa8a1 req-178c1a46-20a2-42a0-a17d-cdde046cd7f5 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.162411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-1c40b11c-609a-453c-abd9-1c7d59aaa8a1 req-178c1a46-20a2-42a0-a17d-cdde046cd7f5 service nova] Creating event network-vif-plugged:165dd833-be3f-4680-b710-242e36dcdfa1 for instance e023bb92-5fed-496c-a500-1d424eb6621d on hv-cinder-84713 Aug 02 10:24:02.167649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-1c40b11c-609a-453c-abd9-1c7d59aaa8a1 req-178c1a46-20a2-42a0-a17d-cdde046cd7f5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033003 Aug 02 10:24:02.168242 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 442/885] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:02.221097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:02.221755 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:02.223728 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:02.224412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:02.230545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.231019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.231815 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:02.232256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:02.367902 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:02.376168 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f3caca98-5802-4b45-a53f-52d6281743fb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.158911 Aug 02 10:24:02.376767 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 444/886] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:02 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:03.398698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:03.399409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:03.406113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.406563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.407361 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:03.407833 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:03.410443 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:03.540706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:03.548713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-74c471ad-eb15-473d-8869-5f97f38c972c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1366 microversion: 2.1 time: 0.154737 Aug 02 10:24:03.549272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 443/887] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:03 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:04.569665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:04.570314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:04.577609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.578099 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.578873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.579316 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.707413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:04.715092 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8109bb19-4680-4217-84b1-75f3eece8a3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1555 microversion: 2.1 time: 0.149457 Aug 02 10:24:04.715673 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 445/888] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:04 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:04.735979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:04.736533 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:04.743418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.743876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.744725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:04.745122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:04.826418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-25a4e3ad-ffe6-4776-b962-05c990a9d96b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094185 Aug 02 10:24:04.827014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 444/889] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:24:04 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:06.445421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-f6fcb17c-0558-47a1-a86e-74986638d915 req-adb3413c-c5e4-407f-b5cb-1a96d43cc963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023bb92-5fed-496c-a500-1d424eb6621d", "tag": "165dd833-be3f-4680-b710-242e36dcdfa1"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:06.456230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f6fcb17c-0558-47a1-a86e-74986638d915 req-adb3413c-c5e4-407f-b5cb-1a96d43cc963 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:06.456673 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f6fcb17c-0558-47a1-a86e-74986638d915 req-adb3413c-c5e4-407f-b5cb-1a96d43cc963 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:06.467564 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-f6fcb17c-0558-47a1-a86e-74986638d915 req-adb3413c-c5e4-407f-b5cb-1a96d43cc963 service nova] Creating event network-changed:165dd833-be3f-4680-b710-242e36dcdfa1 for instance e023bb92-5fed-496c-a500-1d424eb6621d on hv-cinder-84713 Aug 02 10:24:06.472447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-f6fcb17c-0558-47a1-a86e-74986638d915 req-adb3413c-c5e4-407f-b5cb-1a96d43cc963 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Aug 02 10:24:06.473043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 446/890] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:16.734625 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:16.735443 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=9 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:16.739286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:16.739776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:16.747185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.747630 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.748392 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:16.748830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:16.777769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9ff741b4-0875-4f59-b364-2920eab5e582 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/ips" status: 200 len: 152 microversion: 2.20 time: 0.044499 Aug 02 10:24:16.778900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 445/891] 10.222.0.82 () {60 vars in 1289 bytes} [Tue Aug 2 10:24:16 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:24:18.555700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:18.556442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=62 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:18.560726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:18.561352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:18.568637 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.569086 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.569876 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.570315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.594356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lazy-loading 'flavor' on Instance uuid 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:24:18.773828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-32d06b01-80c0-4af4-8430-799b2facfbfa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/action" status: 202 len: 0 microversion: 2.20 time: 0.219470 Aug 02 10:24:18.774448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 447/892] 10.222.0.82 () {62 vars in 1319 bytes} [Tue Aug 2 10:24:18 2022] POST /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:24:18.783239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:18.783855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:18.790327 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.790805 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.791629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:18.792176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:18.924358 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.932047 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.933527 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:18.934705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d5ae3319-3028-40c9-bacb-9183f0e82972 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.155483 Aug 02 10:24:18.935260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 446/893] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:18 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:19.959136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:19.959839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:19.966255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.966712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:19.967481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:19.967920 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:20.102125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.110627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.112146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:20.113311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-04b0fe4a-f080-46b3-8c3c-bbfd9d667aab tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.159059 Aug 02 10:24:20.113888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 448/894] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:19 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:21.136529 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:21.137183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:21.144318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:21.144681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:21.145413 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:21.145873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:21.272569 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:21.280311 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:21.281807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:21.282964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4ef947f8-14fe-4676-8c3f-055058aeac00 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.150343 Aug 02 10:24:21.283518 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 447/895] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:21 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:22.305799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:22.306435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:22.313034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:22.313486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:22.314294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:22.314741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:22.447128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.456593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.458143 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:22.459318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-37b47302-b16a-48cc-986f-62f88f7fe069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.157479 Aug 02 10:24:22.459918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 449/896] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:22 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:23.482923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:23.483545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:23.490127 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:23.490581 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.491349 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:23.491787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:23.623012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.631161 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.632677 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:23.633859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-77393352-b5ae-49bf-8621-c06787768be0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.154978 Aug 02 10:24:23.634425 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 448/897] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:23 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:24.658692 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:24.659298 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:24.666654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.667237 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.668184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:24.668617 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:24.799449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:24.807696 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:24.809753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:24.810943 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3a071d53-627e-40e7-840a-0545f887830c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.156235 Aug 02 10:24:24.811645 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 450/898] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:24 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:25.834688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:25.835292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:25.841586 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:25.842086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:25.842846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:25.843284 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:25.972745 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.981090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.982636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:25.983849 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6956b5b3-ee1a-450d-a4b2-331a40a3dfe7 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.153061 Aug 02 10:24:25.984411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 449/899] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:25 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:27.007668 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:27.008282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:27.015472 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.015927 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.016759 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:27.017201 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:27.145721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.153721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.155296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:27.156491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9a937bd8-0f8e-4abf-afad-0d3f0709a1cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.152807 Aug 02 10:24:27.157051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 451/900] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:27 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:28.179490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:28.180036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:28.187133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:28.187590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.188359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:28.188797 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:28.315114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.323195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.324734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:28.325915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0bcde833-0429-48d1-9a20-f53a08a2a70e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.150325 Aug 02 10:24:28.326526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 450/901] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:28 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:29.349163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:29.349860 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:29.357171 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.357620 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.358444 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:29.358883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:29.489628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:29.497489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:29.499014 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:29.500162 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-89856ad5-72e1-435c-9848-d955f25a0e5d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.155071 Aug 02 10:24:29.500715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 452/902] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:29 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:30.524373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:30.524995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:30.532218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:30.532668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:30.533489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:30.533970 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:30.670116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.678180 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.679620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:30.680784 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a2df8aa0-e843-44b5-8c00-b79d5ea5e12a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.161139 Aug 02 10:24:30.681338 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 451/903] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:30 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:31.705227 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:31.705869 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:31.712435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.712888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.713661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:31.714138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:31.848049 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.855984 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.857498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:31.858685 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b6d0fcad-1ae3-4d41-902b-7e4093cdb838 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.157676 Aug 02 10:24:31.859251 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 453/904] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:31 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:32.882598 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:32.883218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:32.890247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.890702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:32.891468 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:32.891903 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:33.019855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.027698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.029771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:33.030951 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8e9add7a-8530-472e-b134-d6c187a311ee tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.152254 Aug 02 10:24:33.031512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 452/905] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:32 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:34.053942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:34.054588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:34.061601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.062084 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.062851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.063290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.195070 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.203918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.205422 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:34.206612 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2532e03e-4ec4-42fb-887d-8cd6539f5932 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.156601 Aug 02 10:24:34.207172 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 454/906] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:34 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:34.251623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-92851eae-1216-4e43-a70e-352129204673 req-fd281bad-f2b0-4eeb-adf2-9011c36ee941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "name": "network-vif-plugged", "status": "completed", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:34.261202 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-92851eae-1216-4e43-a70e-352129204673 req-fd281bad-f2b0-4eeb-adf2-9011c36ee941 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:34.261619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-92851eae-1216-4e43-a70e-352129204673 req-fd281bad-f2b0-4eeb-adf2-9011c36ee941 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:34.277297 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-92851eae-1216-4e43-a70e-352129204673 req-fd281bad-f2b0-4eeb-adf2-9011c36ee941 service nova] Creating event network-vif-plugged:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:24:34.282953 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-92851eae-1216-4e43-a70e-352129204673 req-fd281bad-f2b0-4eeb-adf2-9011c36ee941 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035508 Aug 02 10:24:34.283797 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 453/907] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:35.230508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:35.231617 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:35.238052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.238517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.239274 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:35.239715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:35.368040 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:35.376107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:35.377622 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:35.378823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4e8d3799-717d-4d60-a671-99282bf876f6 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.152298 Aug 02 10:24:35.379379 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 455/908] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:35 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:36.403692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:36.404385 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:36.410662 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:36.411110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.411868 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:36.412304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:36.539063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.546870 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.548363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:36.549521 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-951f6e37-f069-403b-b1e1-ed9b2d9acfa9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.151287 Aug 02 10:24:36.550111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 454/909] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:36 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:37.572685 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:37.573295 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:37.580559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.581012 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.581800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:37.582273 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:37.719759 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.727629 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.729148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:37.730347 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d03b2d03-9866-4024-9b94-8893711b913e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1744 microversion: 2.20 time: 0.161834 Aug 02 10:24:37.730912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 456/910] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:37 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:38.753177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:38.753813 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:38.761093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:38.761547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:38.762356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:38.762797 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:38.899461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.907367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.908865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:38.910048 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bc188dc4-246f-4a0d-be3e-918d7c68b2cf tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.160831 Aug 02 10:24:38.910616 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 455/911] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:38 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:39.934782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:39.935387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:39.943565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:39.944400 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:39.945457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:39.946345 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:40.095942 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:40.104488 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:40.105998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:40.107567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c283e354-dad5-4b15-ac6f-838e97ac0490 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.177703 Aug 02 10:24:40.111908 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 457/912] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:39 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:41.131777 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:41.133070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:41.140593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.141081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.142451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:41.143090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:41.282077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.290471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.291940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:41.294137 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e48c97d4-d94f-4524-8233-d501a0b5db95 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.166662 Aug 02 10:24:41.294813 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 456/913] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:41 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:42.318604 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:42.319512 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:42.328619 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.329088 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.329903 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:42.331145 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:42.493862 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.502075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.503599 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:42.504779 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-35764125-a7ac-4584-af88-9fe4b9fa4324 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.190127 Aug 02 10:24:42.505337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 458/914] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:42 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:43.556004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:43.556735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:43.563410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.564208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.565227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:43.565905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:43.775458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.785078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.786779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:43.788123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-17bd87a6-00e8-4b51-967f-ee52fe62863c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.236066 Aug 02 10:24:43.793910 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 457/915] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:43 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:44.423488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-10b0db16-0578-4b6b-8c74-72cb4798bd15 req-417e4c35-e240-4869-a21d-1f53f768bea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:44.426133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:44.428139 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:44.452709 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.453172 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.456776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-10b0db16-0578-4b6b-8c74-72cb4798bd15 req-417e4c35-e240-4869-a21d-1f53f768bea4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.456965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.457220 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-10b0db16-0578-4b6b-8c74-72cb4798bd15 req-417e4c35-e240-4869-a21d-1f53f768bea4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.457362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.473402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-10b0db16-0578-4b6b-8c74-72cb4798bd15 req-417e4c35-e240-4869-a21d-1f53f768bea4 service nova] Creating event network-changed:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:24:44.478962 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-10b0db16-0578-4b6b-8c74-72cb4798bd15 req-417e4c35-e240-4869-a21d-1f53f768bea4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059023 Aug 02 10:24:44.479953 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 458/916] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:24:44.491130 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:24:44.584097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:44.636800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ddd88729-e907-475c-bc50-3f097b418c59 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 204 len: 0 microversion: 2.1 time: 0.218368 Aug 02 10:24:44.637507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 459/917] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:24:44 2022] DELETE /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:24:44.648161 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:44.648735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:44.659499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.659948 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.660722 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.661149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.816433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:44.817948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:44.823501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.824150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.825452 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:44.826714 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:44.827498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:44.843523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-41f5ad22-a0f9-487f-87e2-3e1dcf4e15b2 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.200696 Aug 02 10:24:44.846914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 459/918] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:44 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:44.997051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:45.006089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:45.008113 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:45.008964 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-364239f7-7ddc-4702-b1ed-f5982025547b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.197302 Aug 02 10:24:45.009771 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 460/919] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:44 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:45.867185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:45.867830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:45.875445 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.884829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:45.884829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:45.884829 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.035902 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:46.037640 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:46.048936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.049456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.050462 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:46.051058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:46.082203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.095686 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-aca5a513-74a6-432f-9737-cad36632cb7e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.232442 Aug 02 10:24:46.097692 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 460/920] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:45 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:46.249173 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.263982 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.265561 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:46.266758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-51988d2a-f837-438a-a7bd-a765869be7c5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.238041 Aug 02 10:24:46.282178 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 461/921] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:46 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:47.119016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:47.119650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:47.126487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=33 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:47.128165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.128807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.129815 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.130423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.135766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=87 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:47.293847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:47.294930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:47.310486 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.311471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.311720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:47.317857 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:47.668718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.677279 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e4ca5d97-1a47-4dd8-ba4d-247ed12777d6 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1569 microversion: 2.1 time: 0.561971 Aug 02 10:24:47.678304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 461/922] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:47 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1569 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:24:47.680712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.691010 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.695301 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:47.696846 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b296ce0c-d29b-4e84-a0f5-055db3cc9275 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.408288 Aug 02 10:24:47.706195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 462/923] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:47 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:24:48.126083 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-9f48c90c-bd32-4150-a6b6-fcc4fa1d0734 req-5de0445a-912f-4ed3-ae26-f23507a97deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c357fc24-f64c-4a36-9daf-18964c425d8e", "name": "network-vif-deleted", "tag": "8acfadcc-3759-4276-96c7-ca1acc015383"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:48.137202 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-9f48c90c-bd32-4150-a6b6-fcc4fa1d0734 req-5de0445a-912f-4ed3-ae26-f23507a97deb service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.137666 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-9f48c90c-bd32-4150-a6b6-fcc4fa1d0734 req-5de0445a-912f-4ed3-ae26-f23507a97deb service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.150934 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-9f48c90c-bd32-4150-a6b6-fcc4fa1d0734 req-5de0445a-912f-4ed3-ae26-f23507a97deb service nova] Creating event network-vif-deleted:8acfadcc-3759-4276-96c7-ca1acc015383 for instance c357fc24-f64c-4a36-9daf-18964c425d8e on hv-cinder-84713 Aug 02 10:24:48.159486 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-9f48c90c-bd32-4150-a6b6-fcc4fa1d0734 req-5de0445a-912f-4ed3-ae26-f23507a97deb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036988 Aug 02 10:24:48.162944 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 462/924] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:48.702382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:48.703712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:48.709480 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:48.714165 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.714880 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.721616 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:48.723012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:48.726760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.727922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.735730 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.739359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.740443 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.740893 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.777336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:48.778249 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:48.778965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lazy-loading 'fault' on Instance uuid c357fc24-f64c-4a36-9daf-18964c425d8e {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:24:48.866567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b672b80961445c3a3a9b2d784f64208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a92325ab3d4ec2bbecffb9a6e609d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.883560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4438ad11-0f22-494b-a456-ddaa55847fc5 tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 200 len: 1224 microversion: 2.1 time: 0.188164 Aug 02 10:24:48.884134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 463/925] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:48 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 1224 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:24:48.954521 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.963006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.964788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:48.966163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-be79141f-7590-49f0-9cb5-a5ef332d9c88 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.248819 Aug 02 10:24:48.974148 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 463/926] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:48 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:49.905154 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.905773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] [instance: c357fc24-f64c-4a36-9daf-18964c425d8e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.912350 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.912809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.913580 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.914060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:49.927750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] HTTP exception thrown: Instance c357fc24-f64c-4a36-9daf-18964c425d8e could not be found. Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Request method failure captured: Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e HTTP/1.1 Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PnKiq1Esfoz4EiuC34K1RPDHScoVdv-run-rhEqK3lqdYQgVbxOXXpL_Vo2xTD7vFcL-bTEipGEr4_MoQEtQWjROcTFm4ko7Ww6j2PRhvebI5i6h-6xmSc-xvWkLJzURdqZe9tZetDPcml1MfIfyIaOqKT1tjDZBYbdc8CIzktWVYA Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 99a92325ab3d4ec2bbecffb9a6e609d5 Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-TestShelveInstance-1649626054 Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:24:49.929368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/99a92325ab3d4ec2bbecffb9a6e609d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/99a92325ab3d4ec2bbecffb9a6e609d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/99a92325ab3d4ec2bbecffb9a6e609d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_99a92325ab3d4ec2bbecffb9a6e609d5", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-TestShelveInstance-1649626054 Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 99a92325ab3d4ec2bbecffb9a6e609d5 Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-TestShelveInstance-1649626054 Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-TestShelveInstance-1649626054-project Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 7b672b80961445c3a3a9b2d784f64208 Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-TestShelveInstance-1649626054-project Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance c357fc24-f64c-4a36-9daf-18964c425d8e could not be found. Aug 02 10:24:49.931077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'c357fc24-f64c-4a36-9daf-18964c425d8e'} Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c357fc24-f64c-4a36-9daf-18964c425d8e could not be found. Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:24:49.932234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c357fc24-f64c-4a36-9daf-18964c425d8e could not be found. Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c357fc24-f64c-4a36-9daf-18964c425d8e could not be found. Aug 02 10:24:49.933875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:24:49.935442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Returning 404 to user: Instance c357fc24-f64c-4a36-9daf-18964c425d8e could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:24:49.935442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b48b81c3-a694-4e4b-9206-0133628f848e tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e" status: 404 len: 111 microversion: 2.1 time: 0.030216 Aug 02 10:24:49.935442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 464/927] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/c357fc24-f64c-4a36-9daf-18964c425d8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:24:49.992151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:49.992795 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:49.999273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:49.999799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:50.000646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:50.001827 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:50.159074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f0735e12-8494-4074-b8f9-2f2ab49bd7ea tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] Calling method '.version_select at 0x7f5c037f04c0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:50.168794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:50.177941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:50.179465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:50.180707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2e10664d-c33d-4111-9429-35007613a6a9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1739 microversion: 2.20 time: 0.192569 Aug 02 10:24:50.181289 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 464/928] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:49 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:50.182321 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f0735e12-8494-4074-b8f9-2f2ab49bd7ea tempest-TestShelveInstance-1649626054 tempest-TestShelveInstance-1649626054-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1707332186" status: 202 len: 0 microversion: 2.1 time: 0.027215 Aug 02 10:24:50.187045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 465/929] 10.222.0.82 () {58 vars in 1254 bytes} [Tue Aug 2 10:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1707332186 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:24:51.212776 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:51.213366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:51.220743 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.221195 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.222005 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:51.222446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:51.559924 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:51.569679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:51.571474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:51.572680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d9a638ec-3cd3-498e-a7aa-07b841b83910 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1721 microversion: 2.20 time: 0.363871 Aug 02 10:24:51.573271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 465/930] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:51 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:52.596595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:52.597989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:52.605574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.606137 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.607151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:52.607754 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:52.818655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:52.829197 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:52.830870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:52.832187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f1775f68-4f72-4e51-98e2-24da81df07ce tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1721 microversion: 2.20 time: 0.239561 Aug 02 10:24:52.833148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 466/931] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:52 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:53.858401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:53.859035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:53.866798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.867391 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:53.868538 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:53.868993 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:54.097723 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:54.107479 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:54.109263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:54.110782 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9e05098d-ada7-48de-968a-e627ff38b082 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1721 microversion: 2.20 time: 0.257047 Aug 02 10:24:54.128840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 466/932] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:53 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:54.253232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-7bcbb6b1-f894-403d-a394-c673da7a40f6 req-4d05e86e-1933-4c54-a743-15b1e04d052f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "name": "network-vif-unplugged", "status": "completed", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:54.265327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-7bcbb6b1-f894-403d-a394-c673da7a40f6 req-4d05e86e-1933-4c54-a743-15b1e04d052f service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:54.265905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-7bcbb6b1-f894-403d-a394-c673da7a40f6 req-4d05e86e-1933-4c54-a743-15b1e04d052f service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:54.279253 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-7bcbb6b1-f894-403d-a394-c673da7a40f6 req-4d05e86e-1933-4c54-a743-15b1e04d052f service nova] Creating event network-vif-unplugged:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:24:54.284577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-7bcbb6b1-f894-403d-a394-c673da7a40f6 req-4d05e86e-1933-4c54-a743-15b1e04d052f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035154 Aug 02 10:24:54.285863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 467/933] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:55.137120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:55.139489 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:55.152524 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.154531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.155598 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.155940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.294587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:55.302608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:55.304420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:55.305601 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-02d28584-5eec-4741-bf2f-786f666d2013 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1664 microversion: 2.20 time: 0.172932 Aug 02 10:24:55.306209 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 467/934] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:55 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:55.332774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f7d556c-2047-4bc3-a390-a8ba31b117a3"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:55.335272 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:55.342543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.342992 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.343782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.344387 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.646177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b07febb6-49a7-406e-ad01-9c17b223943d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320571 Aug 02 10:24:55.647150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 468/935] 10.222.0.82 () {62 vars in 1364 bytes} [Tue Aug 2 10:24:55 2022] POST /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:24:55.795647 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:55.796063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:55.802036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.802485 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:55.803459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:55.803897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.094016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-762dc20d-da57-4aae-b0ae-a6cf2e3349c1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-volume_attachments/3f7d556c-2047-4bc3-a390-a8ba31b117a3" status: 202 len: 0 microversion: 2.20 time: 0.302927 Aug 02 10:24:56.097595 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 468/936] 10.222.0.82 () {60 vars in 1457 bytes} [Tue Aug 2 10:24:55 2022] DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-volume_attachments/3f7d556c-2047-4bc3-a390-a8ba31b117a3 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:24:56.156915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:56.157513 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:56.163885 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.164345 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.165120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.165563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.196837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118032) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 10:24:56.265042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-eb6f7cbe-83a7-4b12-b560-815352beeb47 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "POST /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/action" status: 202 len: 0 microversion: 2.20 time: 0.112032 Aug 02 10:24:56.266021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 469/937] 10.222.0.82 () {62 vars in 1319 bytes} [Tue Aug 2 10:24:56 2022] POST /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:24:56.274187 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:56.275952 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:56.284997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.285721 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.286926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:56.287640 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:56.441512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:56.466336 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:56.468278 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:56.469986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0b84dd07-6441-499b-871a-6d02958f67e8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1672 microversion: 2.20 time: 0.199851 Aug 02 10:24:56.470872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 469/938] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:56 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:57.495348 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:57.495959 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:57.502224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.502672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.503435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.503887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.527178 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:57.528312 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:57.535029 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.535722 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.536668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:57.537270 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:57.564087 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6bad68ce-943e-49fe-a778-f0724bfbd0b1 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/ips" status: 200 len: 145 microversion: 2.1 time: 0.041368 Aug 02 10:24:57.564674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 470/939] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:24:57 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:24:57.741589 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:57.751568 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:57.753065 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:57.754287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-808b7ddb-a5fa-4603-9b06-6ce945261d04 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.263414 Aug 02 10:24:57.770013 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 470/940] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:57 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:58.780178 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:24:58.780827 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:58.787558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.788014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.788999 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:58.789897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:58.958238 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.968077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.970237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:24:58.971847 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5803e2c5-f726-48a7-a9b0-c3b3fdebd284 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.196858 Aug 02 10:24:58.986213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 471/941] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:58 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:24:59.003648 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3c0218d-d6b6-4477-a2a3-b39a23369f07"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:24:59.007113 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:24:59.015360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.016133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:24:59.017148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:24:59.018410 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.002557 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:00.003638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:00.012011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.012461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.013275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:00.013715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:00.150789 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:00.158689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:00.160212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:00.161364 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d4f7bfd1-b8f3-43d7-9f82-fa6bedb016d8 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.165976 Aug 02 10:25:00.161930 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 472/942] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:24:59 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:01.184470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:01.185111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:01.191498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.191955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.192777 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:01.193219 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:01.333352 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:01.342409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:01.343913 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:01.345430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-385176c6-10cc-4afc-8763-6183dbe84443 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.164974 Aug 02 10:25:01.346261 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 473/943] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:01 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:02.368665 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:02.369331 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:02.376498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.376954 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.377819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:02.378256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:02.523712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:02.532751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:02.534594 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:02.536001 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c3fd76f7-9504-4cba-931a-f7dfe9d06a91 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.171223 Aug 02 10:25:02.537114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 474/944] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:02 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:03.560595 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:03.561274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:03.567662 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.568111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.568873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:03.569308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:03.706573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:03.716713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:03.718244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:03.719577 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e9543cd9-4edf-4c7c-9623-0ef88390207b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.162829 Aug 02 10:25:03.720522 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 475/945] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:03 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:04.747693 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:04.748543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:04.755301 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.755755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.756537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:04.756980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:04.761187 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:04.898118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:04.906051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:04.907534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:04.908685 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-55f47bcf-5e58-4910-aa22-c19b5dc4d4bd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.166681 Aug 02 10:25:04.909233 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 476/946] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:04 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:05.932309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:05.933034 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:05.950799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.951268 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:05.952214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:05.952844 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:06.097020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:06.105357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:06.106845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:06.108023 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-72ca4161-8f79-4c5e-a562-2c8cb3d2c3db tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.179657 Aug 02 10:25:06.108576 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 477/947] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:05 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:07.132432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:07.133070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:07.140420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.140952 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.141865 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:07.142366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:07.291117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:07.300946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:07.302676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:07.303974 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8890e520-ee50-4606-8acf-bcffa106c7a3 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.175803 Aug 02 10:25:07.304619 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 478/948] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:07 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:08.328845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:08.329561 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:08.336630 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.337081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.337921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:08.338328 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:08.480480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:08.506003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:08.507554 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:08.508757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1d1efa2a-a49a-4539-b3f1-e1c06894ed74 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.184491 Aug 02 10:25:08.509572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 479/949] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:08 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:09.016681 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:09.115213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:09.532302 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:09.532920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:09.539757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.540213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.540976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:09.541412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:09.678175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:09.686732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:09.688246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:09.689422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-432ae4b7-9dc0-4236-b71b-60280a930ec5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.161392 Aug 02 10:25:09.690007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 480/950] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:09 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:10.712587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:10.713261 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:10.720113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.720562 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.721327 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:10.721767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:10.849065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:10.857769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:10.859295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:10.860466 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-26614d3e-9a01-410a-b5dd-0ae22cb1beed tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.151931 Aug 02 10:25:10.861019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 481/951] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:10 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:11.885011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:11.885631 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:11.892846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.893294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:11.894155 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:11.894588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:12.025229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:12.033150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:12.034691 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:12.035862 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ad0504cc-892f-43d0-8a7a-d21a8f8d4dfd tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.154714 Aug 02 10:25:12.036421 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 482/952] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:11 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:13.057732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:13.058793 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:13.066007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.066465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.067256 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:13.067695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:13.218744 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:13.227057 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:13.228565 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:13.229747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b63d670d-0ce4-4c04-96c9-fe57c018c2de tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.175909 Aug 02 10:25:13.230323 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 483/953] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:13 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:25:13.249654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9517d1e2-a7c3-4dd4-99c9-db4e5326947f tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.250184 Aug 02 10:25:13.250721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 471/954] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:24:58 2022] POST /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments => generated 194 bytes in 14252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:14.267113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:14.268203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:14.277603 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.278092 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.278876 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:14.279320 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:14.407701 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:14.415540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:14.417031 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:14.418214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b7aeda42-4e2d-4e53-acdb-a2ed6ef4178f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.157582 Aug 02 10:25:14.418772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 484/955] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:14 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:15.442521 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:15.443370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:15.449727 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.450213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.450980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:15.451422 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:15.584874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:15.592809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:15.594352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:15.595516 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7d511b82-b91a-41cb-b466-fd27b95bb25a tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.157808 Aug 02 10:25:15.596075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 472/956] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:15 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:16.618766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:16.619393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:16.626403 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.626857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.627621 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:16.628059 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:16.757926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:16.768700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:16.770249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:16.771412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-eb571f26-3310-4373-9e7f-bbd3ae7bf49e tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.156529 Aug 02 10:25:16.771963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 485/957] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:16 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:17.794277 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:17.794887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:17.801524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.802016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.802788 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:17.803229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:17.935819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:17.943962 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:17.945731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:17.946918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3c899ba2-8358-4841-b572-806f0213a67f tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.156552 Aug 02 10:25:17.947477 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 473/958] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:17 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:18.433607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-7eb3a8d8-a10a-4ba2-bd35-e8cdf0206a37 req-66c82aad-e02d-4a27-82a5-8e38c5907c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "name": "network-vif-plugged", "status": "completed", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:18.439119 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=50 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:18.447577 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-7eb3a8d8-a10a-4ba2-bd35-e8cdf0206a37 req-66c82aad-e02d-4a27-82a5-8e38c5907c82 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.448034 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-7eb3a8d8-a10a-4ba2-bd35-e8cdf0206a37 req-66c82aad-e02d-4a27-82a5-8e38c5907c82 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.460308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-7eb3a8d8-a10a-4ba2-bd35-e8cdf0206a37 req-66c82aad-e02d-4a27-82a5-8e38c5907c82 service nova] Creating event network-vif-plugged:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:25:18.466520 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-7eb3a8d8-a10a-4ba2-bd35-e8cdf0206a37 req-66c82aad-e02d-4a27-82a5-8e38c5907c82 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036580 Aug 02 10:25:18.467203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 486/959] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:18.970308 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:18.970951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:18.977421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.977898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:18.978660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:18.979095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:19.108610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:19.116712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:19.118229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:19.119394 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-47139cae-1803-454f-8705-1568964c5633 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.153013 Aug 02 10:25:19.119959 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 474/960] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:18 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:20.143506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:20.144102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:20.150894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.151350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.152246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:20.153209 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:20.288902 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:20.296757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:20.298289 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:20.299458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3a9e53d4-f351-4910-b9ce-ef3709fa0eb0 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.160335 Aug 02 10:25:20.300012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 487/961] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:20 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:21.322888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:21.323429 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:21.331546 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.332000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.332779 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:21.333221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:21.465593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:21.473573 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:21.475094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:21.476241 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-88594579-00cd-49e9-97b6-aef2d22cb3aa tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1730 microversion: 2.20 time: 0.157655 Aug 02 10:25:21.476789 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 475/962] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:21 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:22.499653 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:22.500314 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:22.506782 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.507237 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.508038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.508480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.647044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:22.655102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:22.656680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:22.657835 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c45cecc9-3695-4221-bdae-3d9dc08e0dd9 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1717 microversion: 2.20 time: 0.162580 Aug 02 10:25:22.658393 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 488/963] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:25:22 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:25:22.890803 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:22.893210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:22.899738 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.900184 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.900940 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.901370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.930176 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6597881b-c203-479b-b850-cfa46cc271f4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Aug 02 10:25:22.930653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 476/964] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:22 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:22.942103 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:22.942605 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:22.949343 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.949812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.950593 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:22.951038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:22.979272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7e18f804-8ce6-45ff-ac6a-cc5808d5420b tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/b3c0218d-d6b6-4477-a2a3-b39a23369f07" status: 200 len: 194 microversion: 2.1 time: 0.041085 Aug 02 10:25:22.979835 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 489/965] 10.222.0.82 () {58 vars in 1413 bytes} [Tue Aug 2 10:25:22 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/b3c0218d-d6b6-4477-a2a3-b39a23369f07 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:24.302874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d3ae6b-5ce1-4534-b4c5-040714ae6e30"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:24.305211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:24.312126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.312572 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.313327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:24.313757 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:24.566182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bc351d45-8cd3-471f-8ef3-b1614a0bc999 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "POST /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267056 Aug 02 10:25:24.566823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 477/966] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:25:24 2022] POST /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:32.082478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:32.084705 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:32.091543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.091995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.092766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.093204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.121699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-50d4c16a-0ed8-4048-948c-811c448a461e tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043118 Aug 02 10:25:32.122276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 490/967] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:32 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:32.270414 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:32.270955 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:32.277169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.277616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.278436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.278871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.306630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-07531870-5037-4f39-93e6-12de7669b4b4 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/b3c0218d-d6b6-4477-a2a3-b39a23369f07" status: 200 len: 194 microversion: 2.1 time: 0.041284 Aug 02 10:25:32.307194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 478/968] 10.222.0.82 () {58 vars in 1413 bytes} [Tue Aug 2 10:25:32 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/b3c0218d-d6b6-4477-a2a3-b39a23369f07 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:32.317870 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:32.318373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:32.325012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.325461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.326258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:32.326698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:32.408007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lazy-loading 'services' on Instance uuid 77c0d9df-9530-461d-a4fe-a4f0f97bb79e {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:32.478588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1afb2eeb-ae9d-4c3e-b700-af8255374e83 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/b3c0218d-d6b6-4477-a2a3-b39a23369f07" status: 202 len: 0 microversion: 2.1 time: 0.164419 Aug 02 10:25:32.479165 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 491/969] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:25:32 2022] DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/b3c0218d-d6b6-4477-a2a3-b39a23369f07 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:34.653569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:34.654163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:34.661289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.661749 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.662592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.663035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.695752 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-55cfa583-2e6d-4f1a-a8e1-c8773842f4cb tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/73d3ae6b-5ce1-4534-b4c5-040714ae6e30" status: 200 len: 194 microversion: 2.1 time: 0.046663 Aug 02 10:25:34.696389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 479/970] 10.222.0.82 () {58 vars in 1413 bytes} [Tue Aug 2 10:25:34 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/73d3ae6b-5ce1-4534-b4c5-040714ae6e30 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:34.708000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:34.708568 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:34.716099 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.716556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.717341 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:34.717812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:34.795052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:34.799503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lazy-loading 'services' on Instance uuid 77c0d9df-9530-461d-a4fe-a4f0f97bb79e {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:34.870620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b5e1c040-9f8f-4538-bcf3-66230998f1cd tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/73d3ae6b-5ce1-4534-b4c5-040714ae6e30" status: 202 len: 0 microversion: 2.1 time: 0.167245 Aug 02 10:25:34.871323 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 492/971] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:25:34 2022] DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments/73d3ae6b-5ce1-4534-b4c5-040714ae6e30 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:25:36.040263 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.043309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.049641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.050121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.050877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.051309 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.079532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-18881c05-5110-4cf0-879d-213bdb171273 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043183 Aug 02 10:25:36.080081 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 480/972] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:25:36.189527 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.191866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.198302 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.198759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.199525 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.199964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.228907 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-921a2628-01dd-4f93-8adc-ba51ead50d43 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044067 Aug 02 10:25:36.230038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 493/973] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:25:36.295012 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.295517 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.301485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.301982 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.302741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.303176 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.328097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:25:36.400405 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e80b30e2-17dc-4c52-8250-244edd54f756 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 204 len: 0 microversion: 2.1 time: 0.109446 Aug 02 10:25:36.401191 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 481/974] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:25:36 2022] DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:25:36.410945 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:36.411558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:36.417434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.417920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.418689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:36.419148 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:36.547531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:36.554978 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b9ad1ef6-4111-4e67-8d7e-f503dc8b41b8 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1674 microversion: 2.1 time: 0.148245 Aug 02 10:25:36.555539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 494/975] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:36 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:37.576854 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:37.577555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:37.584121 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.584575 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.585337 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:37.585772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:37.719834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:37.727572 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0f027605-ef35-4d9a-a720-a549370e96c6 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1674 microversion: 2.1 time: 0.155104 Aug 02 10:25:37.728153 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 482/976] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:37 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:38.750963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:38.751885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:38.758502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.758960 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.759738 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:38.760182 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:38.976448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:38.984672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-845b9b0d-a9af-4d58-bf6d-d084b96cacfc tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1674 microversion: 2.1 time: 0.237703 Aug 02 10:25:38.985335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 495/977] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:38 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:39.564341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-a8ea78c4-8c6e-4963-915a-f76fd7246d51 req-65568829-9051-47c5-9002-13b2b5d7a582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c0d9df-9530-461d-a4fe-a4f0f97bb79e", "name": "network-vif-deleted", "tag": "4eb6763c-124b-4481-9746-ae7e57107a50"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:39.570110 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:39.583915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-a8ea78c4-8c6e-4963-915a-f76fd7246d51 req-65568829-9051-47c5-9002-13b2b5d7a582 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:39.584366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-a8ea78c4-8c6e-4963-915a-f76fd7246d51 req-65568829-9051-47c5-9002-13b2b5d7a582 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:39.589489 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:39.610158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-a8ea78c4-8c6e-4963-915a-f76fd7246d51 req-65568829-9051-47c5-9002-13b2b5d7a582 service nova] Creating event network-vif-deleted:4eb6763c-124b-4481-9746-ae7e57107a50 for instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e on hv-cinder-84713 Aug 02 10:25:39.615874 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-a8ea78c4-8c6e-4963-915a-f76fd7246d51 req-65568829-9051-47c5-9002-13b2b5d7a582 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055476 Aug 02 10:25:39.616379 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 483/978] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:40.006336 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.006946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.014087 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.014547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.015327 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.015771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.046932 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.047307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.047963 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lazy-loading 'fault' on Instance uuid 77c0d9df-9530-461d-a4fe-a4f0f97bb79e {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:25:40.096824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e881ae7c60254c12860fff0a40480641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc7ee5e1e7f4f5c8d9de8fa1e48991b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:40.105494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e47f8db5-82a9-4e31-8a25-cc940ef73bf5 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 200 len: 1328 microversion: 2.1 time: 0.102974 Aug 02 10:25:40.106371 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 496/979] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:40.251726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:40.252341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:40.258679 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.259129 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.259935 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:40.260376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:40.283376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-56619657-caf7-48a9-b54e-31354d4e98ea tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/ips" status: 200 len: 148 microversion: 2.1 time: 0.036262 Aug 02 10:25:40.283950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 484/980] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:25:40 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:41.127125 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.127713 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.134113 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.134570 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.135341 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.135778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.148897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] HTTP exception thrown: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Request method failure captured: Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e HTTP/1.1 Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Plskul8E-ecdVJAX9bWOPxg-W3EYRueI4aM_ewJ-ChG25xsjY8ITlsu3OBbHRxTg0NHZRvrXgDTZkY-DHq0pcjFLa9_UrSVchc3c1eWcdHZd1Vi1yIhRGwvmE7clJRAceV_F-vkcL1DTc2AGjhByqwiaDVyPV8R2BcrAJAgEgv9Dtc Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:25:41.150585 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4bc7ee5e1e7f4f5c8d9de8fa1e48991b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: e881ae7c60254c12860fff0a40480641 Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:41.152293 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '77c0d9df-9530-461d-a4fe-a4f0f97bb79e'} Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:41.153318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:41.154911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:41.156366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Returning 404 to user: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:41.156366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-16d3c870-c3ba-458c-8adc-0543319f97a7 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 404 len: 111 microversion: 2.1 time: 0.028803 Aug 02 10:25:41.156366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 497/981] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:41 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:41.160762 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9e563b0f-e63c-4192-9c00-f0c1399280d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '.version_select at 0x7f5c03586430>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:41.180315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9e563b0f-e63c-4192-9c00-f0c1399280d3 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683832414" status: 202 len: 0 microversion: 2.1 time: 0.023371 Aug 02 10:25:41.180889 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 485/982] 10.222.0.82 () {58 vars in 1221 bytes} [Tue Aug 2 10:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683832414 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:41.668848 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3981f3-8314-440f-9c3f-c41649226cb3"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:41.671335 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:41.677670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.678156 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.678933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:41.679371 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:41.952522 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-55c0bdb6-95d3-48c0-8445-27b697627904 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287416 Aug 02 10:25:41.953583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 498/983] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:25:41 2022] POST /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:44.257618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.258150 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.265739 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.266221 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.266992 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.267434 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.280371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] HTTP exception thrown: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Request method failure captured: Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e HTTP/1.1 Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Plskul8E-ecdVJAX9bWOPxg-W3EYRueI4aM_ewJ-ChG25xsjY8ITlsu3OBbHRxTg0NHZRvrXgDTZkY-DHq0pcjFLa9_UrSVchc3c1eWcdHZd1Vi1yIhRGwvmE7clJRAceV_F-vkcL1DTc2AGjhByqwiaDVyPV8R2BcrAJAgEgv9Dtc Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:25:44.282066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4bc7ee5e1e7f4f5c8d9de8fa1e48991b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: e881ae7c60254c12860fff0a40480641 Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.283682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '77c0d9df-9530-461d-a4fe-a4f0f97bb79e'} Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:44.284657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.285941 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.287473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Returning 404 to user: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:44.287473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b65d80ec-e31a-4dbf-b68b-873db0a3a757 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 404 len: 111 microversion: 2.1 time: 0.030390 Aug 02 10:25:44.287473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 486/984] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:25:44 2022] DELETE /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:44.292477 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:44.293189 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: 77c0d9df-9530-461d-a4fe-a4f0f97bb79e] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:44.300093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.300550 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.301326 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:44.301771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:44.315292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] HTTP exception thrown: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Request method failure captured: Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e HTTP/1.1 Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Plskul8E-ecdVJAX9bWOPxg-W3EYRueI4aM_ewJ-ChG25xsjY8ITlsu3OBbHRxTg0NHZRvrXgDTZkY-DHq0pcjFLa9_UrSVchc3c1eWcdHZd1Vi1yIhRGwvmE7clJRAceV_F-vkcL1DTc2AGjhByqwiaDVyPV8R2BcrAJAgEgv9Dtc Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:25:44.316883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4bc7ee5e1e7f4f5c8d9de8fa1e48991b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: e881ae7c60254c12860fff0a40480641 Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.318787 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '77c0d9df-9530-461d-a4fe-a4f0f97bb79e'} Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:44.319741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. Aug 02 10:25:44.321247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:44.323454 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Returning 404 to user: Instance 77c0d9df-9530-461d-a4fe-a4f0f97bb79e could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:44.323454 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-932ac575-19d7-400f-81d2-b002617172aa tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e" status: 404 len: 111 microversion: 2.1 time: 0.030113 Aug 02 10:25:44.323454 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 499/985] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:44 2022] GET /compute/v2.1/servers/77c0d9df-9530-461d-a4fe-a4f0f97bb79e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:45.453844 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.454346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.460735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.461180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.461976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.462412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.476059 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] HTTP exception thrown: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Request method failure captured: Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe HTTP/1.1 Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Plskul8E-ecdVJAX9bWOPxg-W3EYRueI4aM_ewJ-ChG25xsjY8ITlsu3OBbHRxTg0NHZRvrXgDTZkY-DHq0pcjFLa9_UrSVchc3c1eWcdHZd1Vi1yIhRGwvmE7clJRAceV_F-vkcL1DTc2AGjhByqwiaDVyPV8R2BcrAJAgEgv9Dtc Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:25:45.477591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4bc7ee5e1e7f4f5c8d9de8fa1e48991b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: e881ae7c60254c12860fff0a40480641 Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.479196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'df694e6a-8f96-4024-9f32-7fd36d7114fe'} Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:45.480104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.481610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.483414 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Returning 404 to user: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:45.483414 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a75ee4b4-d7d7-4a68-9cf4-7c4f69b3c086 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 404 len: 111 microversion: 2.1 time: 0.029007 Aug 02 10:25:45.483414 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 487/986] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:25:45 2022] DELETE /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:45.487479 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:45.488100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] [instance: df694e6a-8f96-4024-9f32-7fd36d7114fe] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:45.494651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.495104 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.495877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:45.496317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:45.509369 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] HTTP exception thrown: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Request method failure captured: Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe HTTP/1.1 Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Plskul8E-ecdVJAX9bWOPxg-W3EYRueI4aM_ewJ-ChG25xsjY8ITlsu3OBbHRxTg0NHZRvrXgDTZkY-DHq0pcjFLa9_UrSVchc3c1eWcdHZd1Vi1yIhRGwvmE7clJRAceV_F-vkcL1DTc2AGjhByqwiaDVyPV8R2BcrAJAgEgv9Dtc Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:25:45.511437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/4bc7ee5e1e7f4f5c8d9de8fa1e48991b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_4bc7ee5e1e7f4f5c8d9de8fa1e48991b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 4bc7ee5e1e7f4f5c8d9de8fa1e48991b Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388570908 Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: e881ae7c60254c12860fff0a40480641 Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeTestJSON-388570908-project Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.513073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'df694e6a-8f96-4024-9f32-7fd36d7114fe'} Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:45.513921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. Aug 02 10:25:45.515222 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:45.516330 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] Returning 404 to user: Instance df694e6a-8f96-4024-9f32-7fd36d7114fe could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:45.516330 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1bcd626c-aa75-4176-8401-85bea7395b64 tempest-AttachVolumeTestJSON-388570908 tempest-AttachVolumeTestJSON-388570908-project] 10.222.0.82 "GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe" status: 404 len: 111 microversion: 2.1 time: 0.029175 Aug 02 10:25:45.516330 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 500/987] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:45 2022] GET /compute/v2.1/servers/df694e6a-8f96-4024-9f32-7fd36d7114fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:49.523970 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b2294655-182c-4db6-9115-43d10992ad7a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: .version_select at 0x7f5c08062160>, body: {"keypair": {"name": "tempest-keypair-2087033479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQgkbwtVztfRHiCFW+BOT9OkpeypwuSR8T/XUShxK9HEiNIOklZ7o9mfryvinqLbq+qTKTsCzx1smSEmQKb3U16OKfSO/wXfFB8Niw4/UyoyXjVu2GNwJKGrz8bwZc7XQ=="}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:49.541871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-b2294655-182c-4db6-9115-43d10992ad7a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:25:49.546177 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-b2294655-182c-4db6-9115-43d10992ad7a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:25:49.571313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b2294655-182c-4db6-9115-43d10992ad7a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053048 Aug 02 10:25:49.572654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 488/988] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:25:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:50.305415 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c5e4cbad-0e80-4f73-93f2-6f15798de4e1 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Action: 'create', calling method: .version_select at 0x7f5c08097280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1303763688"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:50.622866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c5e4cbad-0e80-4f73-93f2-6f15798de4e1 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.457794 Aug 02 10:25:50.623747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 501/989] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Aug 2 10:25:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 02 10:25:50.637761 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-86b05b0d-2de4-4e05-ac7e-50321f6b85b2 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c037f0790>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:50.693019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-86b05b0d-2de4-4e05-ac7e-50321f6b85b2 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 200 len: 345 microversion: 2.1 time: 0.060647 Aug 02 10:25:50.693918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 489/990] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:25:50 2022] GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:50.917006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-676546459", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c06faac-b7f7-48ef-b76d-6bd0b909a62b"}], "security_groups": [{"name": "tempest-securitygroup--1375619297"}], "key_name": "tempest-keypair-2087033479", "user_data": "}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:50.926120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=32 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:25:51.023968 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] validate_networks() for [('7c06faac-b7f7-48ef-b76d-6bd0b909a62b', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:25:51.389453 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:25:51.390105 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:25:51.390669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:25:51.391162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:25:51.391587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:25:51.401422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.402081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.402944 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:51.403470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:51.422402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:25:51.426541 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:25:51.437801 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:25:51.440060 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:25:51.484501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [03fd9779-e36d-4394-8b32-1392284c5304] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:25:51.708460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-250fc1b1-2d4a-4b2c-b179-acb9e3c66674 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c034e93a0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.754503 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-250fc1b1-2d4a-4b2c-b179-acb9e3c66674 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 200 len: 346 microversion: 2.1 time: 0.051259 Aug 02 10:25:51.755169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 490/991] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:51.767814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-547dce97-24fc-4120-aab0-7e0795ad4d7d tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Action: 'create', calling method: .version_select at 0x7f5c037f0700>, body: {"snapshot": {"volume_id": "ba1cdf84-6baa-4c2b-aac9-5b29da9246f5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1361811212"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:51.916499 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-547dce97-24fc-4120-aab0-7e0795ad4d7d tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.152093 Aug 02 10:25:51.917087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 491/992] 10.222.0.82 () {60 vars in 1162 bytes} [Tue Aug 2 10:25:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:51.928346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3040a84d-56ad-47c9-b71c-90afe0c53237 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c03586f70>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:51.960368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3040a84d-56ad-47c9-b71c-90afe0c53237 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.036234 Aug 02 10:25:51.960888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 492/993] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:51.971069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-06df82bb-562b-4c8a-a49b-71d62cbb3084 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c0378a790>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.001265 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-06df82bb-562b-4c8a-a49b-71d62cbb3084 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033683 Aug 02 10:25:52.001872 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 493/994] 10.222.0.82 () {58 vars in 1140 bytes} [Tue Aug 2 10:25:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:25:52.012565 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-76f8423e-61b4-411c-9338-f07c932605c7 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c03696940>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.041227 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-76f8423e-61b4-411c-9338-f07c932605c7 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.032680 Aug 02 10:25:52.041799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 494/995] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:52.492386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [03fd9779-e36d-4394-8b32-1392284c5304] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 52930. Aug 02 10:25:52.496350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9c74ea58-3d2f-48cd-8744-747f94ad9433 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.584575 Aug 02 10:25:52.497034 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 502/996] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:25:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:25:52.507924 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-390b8224-471d-4572-a84f-3e62513b4a50 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:52.508548 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-390b8224-471d-4572-a84f-3e62513b4a50 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:52.564146 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-390b8224-471d-4572-a84f-3e62513b4a50 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:52.571204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-390b8224-471d-4572-a84f-3e62513b4a50 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1241 microversion: 2.1 time: 0.067078 Aug 02 10:25:52.571811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 495/997] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:52 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:53.054176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-07b15103-18de-42ea-b608-f7fbab3edb55 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c037e9670>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:53.083728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-07b15103-18de-42ea-b608-f7fbab3edb55 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.033876 Aug 02 10:25:53.084281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 503/998] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:53 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:53.594217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:53.595360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:53.603044 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.604039 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.605413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:53.605884 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:53.669069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:53.679861 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5f2156aa-43aa-46bc-ae41-19036b5cf6d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1245 microversion: 2.1 time: 0.091278 Aug 02 10:25:53.680442 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 496/999] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:53 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:54.097294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-74ef93c9-1461-4a0e-96aa-f41822565a14 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c080498b0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.126694 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-74ef93c9-1461-4a0e-96aa-f41822565a14 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.033759 Aug 02 10:25:54.127247 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 504/1000] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:54.702084 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:54.702705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:54.709305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.709896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.710665 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:54.711105 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:54.778964 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:54.786507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4909ff8b-bc86-44da-8409-35bcec06357d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1245 microversion: 2.1 time: 0.088372 Aug 02 10:25:54.787079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 497/1001] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:54 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:55.140305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f480c5fb-3ca8-4ada-8cfa-84f728dd8c8d tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c0377c430>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.171223 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f480c5fb-3ca8-4ada-8cfa-84f728dd8c8d tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.035228 Aug 02 10:25:55.171790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 505/1002] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:55.807437 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:55.808058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:55.814620 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.815098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.815863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:55.816304 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:55.882756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:55.890881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7a69282f-3503-4129-8196-c1cda215e4cc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1245 microversion: 2.1 time: 0.087327 Aug 02 10:25:55.891449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 498/1003] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:55 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:56.183541 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a99d8bb2-771f-4025-87c0-29dffe845385 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c03754160>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.212772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a99d8bb2-771f-4025-87c0-29dffe845385 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.033665 Aug 02 10:25:56.214034 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 506/1004] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:56.912704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:56.913352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:56.919666 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.920114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:56.920888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:56.921327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.005712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:57.013450 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ede7720f-cb34-4b3f-9a5d-edb4a5eb198a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1299 microversion: 2.1 time: 0.104840 Aug 02 10:25:57.014060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 499/1005] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:56 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:57.231765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5daef407-7c44-4a3c-a92c-2b59cf066dd7 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c08049820>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.267755 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5daef407-7c44-4a3c-a92c-2b59cf066dd7 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 288 microversion: 2.1 time: 0.045515 Aug 02 10:25:57.274668 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 507/1006] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:57 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:57.279715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-61f41ba6-7d19-456d-99a7-f4bff2a0978e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c0369c160>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.344100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-61f41ba6-7d19-456d-99a7-f4bff2a0978e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "DELETE /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 202 len: 0 microversion: 2.1 time: 0.068264 Aug 02 10:25:57.344682 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 500/1007] 10.222.0.82 () {58 vars in 1254 bytes} [Tue Aug 2 10:25:57 2022] DELETE /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:57.353860 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3521bbb2-5270-4727-b185-f2a5bd0fedce tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c037e9430>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:57.383199 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3521bbb2-5270-4727-b185-f2a5bd0fedce tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 200 len: 287 microversion: 2.1 time: 0.034056 Aug 02 10:25:57.383771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 508/1008] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:57 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:57.858745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-f1878071-45da-41ff-95eb-934280f0ac6d req-daf16a63-fdde-4f26-80d3-e2d81bea1649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc26b90-7065-470e-b612-ceef2e8f497d", "tag": "1d31ada3-b1d3-4ceb-88db-e7ccbe291f70"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:25:57.869700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f1878071-45da-41ff-95eb-934280f0ac6d req-daf16a63-fdde-4f26-80d3-e2d81bea1649 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:57.870445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f1878071-45da-41ff-95eb-934280f0ac6d req-daf16a63-fdde-4f26-80d3-e2d81bea1649 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:57.881694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-f1878071-45da-41ff-95eb-934280f0ac6d req-daf16a63-fdde-4f26-80d3-e2d81bea1649 service nova] Creating event network-changed:1d31ada3-b1d3-4ceb-88db-e7ccbe291f70 for instance 7fc26b90-7065-470e-b612-ceef2e8f497d on hv-cinder-84713 Aug 02 10:25:57.886859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-f1878071-45da-41ff-95eb-934280f0ac6d req-daf16a63-fdde-4f26-80d3-e2d81bea1649 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Aug 02 10:25:57.887741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 501/1009] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:58.035272 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.035901 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:58.042810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.043268 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.044086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:58.044526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:58.254590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:58.262695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bb1995ca-fda3-4343-94d2-b6fb83d16af2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.231177 Aug 02 10:25:58.263114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 509/1010] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:25:58.397148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ca94bec0-dbdb-485f-930e-ac1c875a138b tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c03517d30>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.422405 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-ca94bec0-dbdb-485f-930e-ac1c875a138b tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] HTTP exception thrown: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ca94bec0-dbdb-485f-930e-ac1c875a138b tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Request method failure captured: Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 HTTP/1.1 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PuuDgTg7s9RDtu07U9VLxM8DKW3eVLjcikLjIDzBSLJcNt4iHfPYXgIPcnZqD4k26i_UQ4VjLsasQyHrBSjM9sYyP3tBZRdMEN52iJL9prtu-2p8u-VXEfjznlvLQPn-WkAr1ZopXfFKcdVvknKt7vWpuhMRBSE2qT5Sxde114r_Z0 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:25:58.424790 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f9fce1883f5f4bc085916d84be562333", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 00cbabc9063245688c7ab9b7d726c6f8 Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '1d1ffc90-4e41-43b3-94ce-695d3046a9d5'} Aug 02 10:25:58.426359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. (HTTP 404) (Request-ID: req-31e843e5-290d-4eed-aa4b-4e3ebbe40f2a) Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.427242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:25:58.428485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 10:25:58.429765 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ca94bec0-dbdb-485f-930e-ac1c875a138b tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Returning 404 to user: Snapshot 1d1ffc90-4e41-43b3-94ce-695d3046a9d5 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:58.431117 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ca94bec0-dbdb-485f-930e-ac1c875a138b tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5" status: 404 len: 111 microversion: 2.1 time: 0.033875 Aug 02 10:25:58.431963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 502/1011] 10.222.0.82 () {58 vars in 1251 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/os-snapshots/1d1ffc90-4e41-43b3-94ce-695d3046a9d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:58.435395 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-962ab9fa-214d-4624-8b1a-843d7669cdf4 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c037e99d0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.495801 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-962ab9fa-214d-4624-8b1a-843d7669cdf4 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 202 len: 0 microversion: 2.1 time: 0.064370 Aug 02 10:25:58.496363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 510/1012] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:25:58 2022] DELETE /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:25:58.504746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bb7c0cae-97f8-4fc4-a3bf-f2b031a83630 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c034e9280>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:58.552508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bb7c0cae-97f8-4fc4-a3bf-f2b031a83630 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 200 len: 345 microversion: 2.1 time: 0.051734 Aug 02 10:25:58.553074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 503/1013] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:25:58 2022] GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:25:59.284367 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.284994 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:25:59.291757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.292286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.293063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:25:59.293505 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:25:59.426916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:25:59.434540 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a20490db-4083-4ce4-af6d-c702c8201e87 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.154506 Aug 02 10:25:59.435114 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 511/1014] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:25:59.567398 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4d43cf52-fbef-403e-ada8-0c0ef62fdd92 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c0369c0d0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.594732 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-4d43cf52-fbef-403e-ada8-0c0ef62fdd92 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] HTTP exception thrown: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4d43cf52-fbef-403e-ada8-0c0ef62fdd92 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Request method failure captured: Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 HTTP/1.1 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PuuDgTg7s9RDtu07U9VLxM8DKW3eVLjcikLjIDzBSLJcNt4iHfPYXgIPcnZqD4k26i_UQ4VjLsasQyHrBSjM9sYyP3tBZRdMEN52iJL9prtu-2p8u-VXEfjznlvLQPn-WkAr1ZopXfFKcdVvknKt7vWpuhMRBSE2qT5Sxde114r_Z0 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:25:59.596697 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f9fce1883f5f4bc085916d84be562333", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 00cbabc9063245688c7ab9b7d726c6f8 Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'ba1cdf84-6baa-4c2b-aac9-5b29da9246f5'} Aug 02 10:25:59.598256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. (HTTP 404) (Request-ID: req-5e3f09d0-7c61-4deb-badf-d139cb4d3673) Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.599158 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:25:59.600574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:25:59.602041 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4d43cf52-fbef-403e-ada8-0c0ef62fdd92 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Returning 404 to user: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4d43cf52-fbef-403e-ada8-0c0ef62fdd92 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 404 len: 109 microversion: 2.1 time: 0.035508 Aug 02 10:25:59.604230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 504/1015] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:59.609012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a9fdea0d-25d8-4f08-9e92-db271bc07510 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c0804fe50>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.636623 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-a9fdea0d-25d8-4f08-9e92-db271bc07510 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] HTTP exception thrown: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a9fdea0d-25d8-4f08-9e92-db271bc07510 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Request method failure captured: Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: DELETE /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 HTTP/1.1 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6PuuDgTg7s9RDtu07U9VLxM8DKW3eVLjcikLjIDzBSLJcNt4iHfPYXgIPcnZqD4k26i_UQ4VjLsasQyHrBSjM9sYyP3tBZRdMEN52iJL9prtu-2p8u-VXEfjznlvLQPn-WkAr1ZopXfFKcdVvknKt7vWpuhMRBSE2qT5Sxde114r_Z0 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:25:59.638612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f9fce1883f5f4bc085916d84be562333", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 00cbabc9063245688c7ab9b7d726c6f8 Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'ba1cdf84-6baa-4c2b-aac9-5b29da9246f5'} Aug 02 10:25:59.640206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. (HTTP 404) (Request-ID: req-6e906a20-1841-4104-9776-3a82f22b778d) Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.641063 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:25:59.642298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 10:25:59.643494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a9fdea0d-25d8-4f08-9e92-db271bc07510 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Returning 404 to user: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:59.644753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a9fdea0d-25d8-4f08-9e92-db271bc07510 tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 404 len: 109 microversion: 2.1 time: 0.034951 Aug 02 10:25:59.645759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 512/1016] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:25:59 2022] DELETE /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:25:59.648520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6db53421-9171-4141-89af-d01526b2a53e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Calling method '.version_select at 0x7f5c037f05e0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:25:59.689535 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-6db53421-9171-4141-89af-d01526b2a53e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] HTTP exception thrown: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6db53421-9171-4141-89af-d01526b2a53e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Request method failure captured: Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 HTTP/1.1 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PuuDgTg7s9RDtu07U9VLxM8DKW3eVLjcikLjIDzBSLJcNt4iHfPYXgIPcnZqD4k26i_UQ4VjLsasQyHrBSjM9sYyP3tBZRdMEN52iJL9prtu-2p8u-VXEfjznlvLQPn-WkAr1ZopXfFKcdVvknKt7vWpuhMRBSE2qT5Sxde114r_Z0 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:25:59.691547 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f9fce1883f5f4bc085916d84be562333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f9fce1883f5f4bc085916d84be562333", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: f9fce1883f5f4bc085916d84be562333 Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2053714396 Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 00cbabc9063245688c7ab9b7d726c6f8 Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2053714396-project Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'ba1cdf84-6baa-4c2b-aac9-5b29da9246f5'} Aug 02 10:25:59.693369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. (HTTP 404) (Request-ID: req-defdbc44-3ad5-4b5c-8489-22a67f863255) Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.694360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:25:59.695823 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:25:59.697721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6db53421-9171-4141-89af-d01526b2a53e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] Returning 404 to user: Volume ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6db53421-9171-4141-89af-d01526b2a53e tempest-VolumesSnapshotsTestJSON-2053714396 tempest-VolumesSnapshotsTestJSON-2053714396-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5" status: 404 len: 109 microversion: 2.1 time: 0.048164 Aug 02 10:25:59.699138 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 505/1017] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:25:59 2022] GET /compute/v2.1/os-volumes/ba1cdf84-6baa-4c2b-aac9-5b29da9246f5 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:26:00.456084 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:00.456702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:00.464147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.464699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.465504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:00.465983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:00.603853 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:00.615487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-dace3e74-6647-4716-8e2b-92595f247f00 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.163679 Aug 02 10:26:00.616054 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 513/1018] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:00 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:01.092455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-19afe20a-ad3a-4f06-b821-8d373573fe68 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Action: 'create', calling method: .version_select at 0x7f5c037f01f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-451177443", "metadata": {"Type": "work"}}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:01.379368 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-19afe20a-ad3a-4f06-b821-8d373573fe68 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.407931 Aug 02 10:26:01.379989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 506/1019] 10.222.0.82 () {60 vars in 1156 bytes} [Tue Aug 2 10:26:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 10:26:01.392801 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-559260c6-2157-4407-8a83-5493c124e8c8 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Calling method '.version_select at 0x7f5c037e9160>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.412941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:01.433508 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:01.442929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-559260c6-2157-4407-8a83-5493c124e8c8 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238" status: 200 len: 352 microversion: 2.1 time: 0.054099 Aug 02 10:26:01.443772 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 514/1020] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:01.636810 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:01.637542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:01.643990 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.644381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.645147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:01.645583 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:01.778045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:01.785370 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a2f85782-1798-4698-bbbf-62154aa69788 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.153038 Aug 02 10:26:01.785948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 507/1021] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:01 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:02.460471 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-88d268b5-e4ab-4d69-9c85-219df90a0c2d tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Calling method '.version_select at 0x7f5c0365b4c0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.633401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-88d268b5-e4ab-4d69-9c85-219df90a0c2d tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238" status: 200 len: 353 microversion: 2.1 time: 0.177133 Aug 02 10:26:02.634019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 515/1022] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:02.646534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d8403705-b3de-45d0-9a6a-d27b29e859ce tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Calling method '.version_select at 0x7f5c037150d0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.653725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:02.761036 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d8403705-b3de-45d0-9a6a-d27b29e859ce tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238" status: 200 len: 353 microversion: 2.1 time: 0.118208 Aug 02 10:26:02.761605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 508/1023] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:02.779306 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e8f4b249-4493-434b-96eb-94c79a6f3981 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Calling method '.version_select at 0x7f5c080975e0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.806174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.806869 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:02.813385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.813953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.814783 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:02.815282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:02.841075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e8f4b249-4493-434b-96eb-94c79a6f3981 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238" status: 202 len: 0 microversion: 2.1 time: 0.066106 Aug 02 10:26:02.841672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 516/1024] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:26:02 2022] DELETE /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:26:02.849360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3adf3448-db70-4e1f-a1e3-b12ff52a256d tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Calling method '.version_select at 0x7f5c037e9dc0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:02.902342 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3adf3448-db70-4e1f-a1e3-b12ff52a256d tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238" status: 200 len: 352 microversion: 2.1 time: 0.056517 Aug 02 10:26:02.902906 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 517/1025] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:02.963485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:02.971094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2ff47080-e9f9-486d-9c55-90eb56efcc03 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.168772 Aug 02 10:26:02.971658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 509/1026] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:02 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:03.916536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b2f72954-8ef0-4b52-84f6-c3f4a2084022 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Calling method '.version_select at 0x7f5c08049dc0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.943873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-b2f72954-8ef0-4b52-84f6-c3f4a2084022 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] HTTP exception thrown: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b2f72954-8ef0-4b52-84f6-c3f4a2084022 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Request method failure captured: Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 HTTP/1.1 Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pu42N3Iprt5paw8DlgDF2hWC9j74ED4pPDJoYNYdNGzr6iGSowkaew-XdkdxGFVTOWQ8sUfY4enwBCILYCAkhMgRCj-ql0lex0a62T9v_NTanMTqY03EDWgDUVft-jXGfaFtb2dZgEpkULY0VEXmJRHeyobWDCj4QmiUEkoKy5hcjU Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: ee4b032eb52149a399dc9d30c3d15b53 Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-VolumesGetTestJSON-1332953003 Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:26:03.945920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ee4b032eb52149a399dc9d30c3d15b53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/ee4b032eb52149a399dc9d30c3d15b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/ee4b032eb52149a399dc9d30c3d15b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_ee4b032eb52149a399dc9d30c3d15b53", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-VolumesGetTestJSON-1332953003 Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: ee4b032eb52149a399dc9d30c3d15b53 Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-VolumesGetTestJSON-1332953003 Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-VolumesGetTestJSON-1332953003-project Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 9f54983a174e490ebed30d0347bffa4e Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-VolumesGetTestJSON-1332953003-project Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'aaf8ddc7-4e3d-4a04-bf11-c17d0a920238'} Aug 02 10:26:03.948164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. (HTTP 404) (Request-ID: req-d47f6012-9ba1-4528-a887-b30db63b9370) Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:03.949179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:26:03.950607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:26:03.951989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-b2f72954-8ef0-4b52-84f6-c3f4a2084022 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] Returning 404 to user: Volume aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-b2f72954-8ef0-4b52-84f6-c3f4a2084022 tempest-VolumesGetTestJSON-1332953003 tempest-VolumesGetTestJSON-1332953003-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238" status: 404 len: 109 microversion: 2.1 time: 0.035794 Aug 02 10:26:03.953539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 518/1027] 10.222.0.82 () {58 vars in 1245 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/os-volumes/aaf8ddc7-4e3d-4a04-bf11-c17d0a920238 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:26:03.992204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:03.992820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:03.999782 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.000234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.001001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.001437 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.141107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:04.148490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e77052bd-984e-4040-9700-eb4b82ab1701 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.160208 Aug 02 10:26:04.149050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 510/1028] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:03 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:04.680003 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-084a9d76-a046-4420-9f2b-f21c20dad0ca req-d0f28820-b623-4eb7-89a1-372a42646989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc26b90-7065-470e-b612-ceef2e8f497d", "name": "network-vif-plugged", "status": "completed", "tag": "1d31ada3-b1d3-4ceb-88db-e7ccbe291f70"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:04.691701 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-084a9d76-a046-4420-9f2b-f21c20dad0ca req-d0f28820-b623-4eb7-89a1-372a42646989 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:04.693281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-084a9d76-a046-4420-9f2b-f21c20dad0ca req-d0f28820-b623-4eb7-89a1-372a42646989 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:04.704757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-084a9d76-a046-4420-9f2b-f21c20dad0ca req-d0f28820-b623-4eb7-89a1-372a42646989 service nova] Creating event network-vif-plugged:1d31ada3-b1d3-4ceb-88db-e7ccbe291f70 for instance 7fc26b90-7065-470e-b612-ceef2e8f497d on hv-cinder-84713 Aug 02 10:26:04.709753 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-084a9d76-a046-4420-9f2b-f21c20dad0ca req-d0f28820-b623-4eb7-89a1-372a42646989 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035702 Aug 02 10:26:04.710643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 519/1029] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:05.169858 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:05.170405 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:05.176836 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.177290 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.178120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:05.178614 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:05.312365 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:05.320093 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-64024761-4aff-47d5-8102-75ea7bd79d9c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.154674 Aug 02 10:26:05.320756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 511/1030] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:05 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:06.341988 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:06.342778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:06.349214 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.349545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.350350 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:06.350794 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:06.353993 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:06.499921 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:06.507480 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d6be124b-0cb8-4976-9895-aebe2137dcc3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1367 microversion: 2.1 time: 0.170670 Aug 02 10:26:06.508031 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 520/1031] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:06 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:07.528963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.529611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.536255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.536706 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.537473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.537936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.677507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:07.686346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2fbec2fd-5833-4250-b22d-cdcc37f3300a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1557 microversion: 2.1 time: 0.161826 Aug 02 10:26:07.687366 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 512/1032] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:07.707543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:07.708093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:07.715020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.715469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.716241 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:07.716690 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:07.794644 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2267dd26-7313-4d5f-9fd6-f285ed4aa3aa tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090867 Aug 02 10:26:07.795233 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 521/1033] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:26:07 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:09.314251 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-ab005a99-ddb4-40be-9f61-cead907d4b04 req-0d657e52-ee1b-40a1-949b-37977167f6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc26b90-7065-470e-b612-ceef2e8f497d", "tag": "1d31ada3-b1d3-4ceb-88db-e7ccbe291f70"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:09.326768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ab005a99-ddb4-40be-9f61-cead907d4b04 req-0d657e52-ee1b-40a1-949b-37977167f6a4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:09.327654 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ab005a99-ddb4-40be-9f61-cead907d4b04 req-0d657e52-ee1b-40a1-949b-37977167f6a4 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:09.343016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-ab005a99-ddb4-40be-9f61-cead907d4b04 req-0d657e52-ee1b-40a1-949b-37977167f6a4 service nova] Creating event network-changed:1d31ada3-b1d3-4ceb-88db-e7ccbe291f70 for instance 7fc26b90-7065-470e-b612-ceef2e8f497d on hv-cinder-84713 Aug 02 10:26:09.349252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-ab005a99-ddb4-40be-9f61-cead907d4b04 req-0d657e52-ee1b-40a1-949b-37977167f6a4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039884 Aug 02 10:26:09.350360 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 513/1034] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:13.569681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:26:13.570268 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:26:14.491087 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:14.491678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:14.498360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.498915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.499766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.500279 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.526012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:26:14.609732 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6513f693-da6a-4290-a2fa-0471a356b4d9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 204 len: 0 microversion: 2.1 time: 0.123118 Aug 02 10:26:14.610645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 522/1035] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:26:14 2022] DELETE /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:26:14.620614 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:14.621319 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:14.623307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:14.629691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.630297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.631079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:14.631522 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:14.636305 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=68 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:14.768189 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:14.778340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7d0f347b-a2cb-41aa-af74-c2473be74087 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1578 microversion: 2.1 time: 0.162823 Aug 02 10:26:14.779128 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 514/1036] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:14 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:15.800494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:15.801231 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:15.807754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.808207 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.808970 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:15.809416 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:15.946208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:15.953761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c483a724-29a2-4386-b0e7-6807547993c1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1578 microversion: 2.1 time: 0.157444 Aug 02 10:26:15.954340 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 523/1037] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:15 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:16.200020 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1360337242", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:16.251286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] validate_networks() for None {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:26:16.526256 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:26:16.526678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:26:16.527149 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:26:16.527566 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:26:16.527967 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:26:16.536866 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.537312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.538136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.538574 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.555089 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Getting quotas for project c3211253f9154419a7511b40e0d1e291. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:26:16.559534 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Getting quotas for user 5a01fa66107e4f989712cd883265a296 and project c3211253f9154419a7511b40e0d1e291. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:26:16.570614 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:26:16.573402 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:26:16.617307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-01693f68-0d2a-4937-a32f-5265adb684dd tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421091 Aug 02 10:26:16.618515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 515/1038] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:26:16.629065 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6a0cf793-5e6d-43f6-b01a-a3365c9bb807 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:16.629676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6a0cf793-5e6d-43f6-b01a-a3365c9bb807 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:16.682543 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6a0cf793-5e6d-43f6-b01a-a3365c9bb807 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:16.689097 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6a0cf793-5e6d-43f6-b01a-a3365c9bb807 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1215 microversion: 2.1 time: 0.063850 Aug 02 10:26:16.689658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 524/1039] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:16 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:16.975775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:16.976601 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:16.985033 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.985996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:16.987004 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:16.987581 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.230340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:17.239571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cb145960-feae-4995-b13b-473ad0fbbade tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1578 microversion: 2.1 time: 0.268899 Aug 02 10:26:17.240258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 516/1040] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:16 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:17.718116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:17.723250 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:17.738301 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.738975 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.739855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.741093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.840421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-f15242a7-d0b8-47f5-b6fd-3fa9ced93be1 req-3e58bde3-54c7-47a0-b6b1-d465f9b3ab81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca275f46-5c0d-4492-8ba8-e0b65fcc42ba", "name": "network-vif-deleted", "tag": "665de422-edc2-4047-ac40-261bdd033d67"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:17.862550 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f15242a7-d0b8-47f5-b6fd-3fa9ced93be1 req-3e58bde3-54c7-47a0-b6b1-d465f9b3ab81 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:17.863019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-f15242a7-d0b8-47f5-b6fd-3fa9ced93be1 req-3e58bde3-54c7-47a0-b6b1-d465f9b3ab81 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:17.890760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-f15242a7-d0b8-47f5-b6fd-3fa9ced93be1 req-3e58bde3-54c7-47a0-b6b1-d465f9b3ab81 service nova] Creating event network-vif-deleted:665de422-edc2-4047-ac40-261bdd033d67 for instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba on hv-cinder-84713 Aug 02 10:26:17.902896 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-f15242a7-d0b8-47f5-b6fd-3fa9ced93be1 req-3e58bde3-54c7-47a0-b6b1-d465f9b3ab81 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066415 Aug 02 10:26:17.903544 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 517/1041] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:17.919380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:17.927574 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-efff3ef1-68f3-4bec-ade9-d5cabfaefad8 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1285 microversion: 2.1 time: 0.220456 Aug 02 10:26:17.928822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 525/1042] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:17 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:18.261030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:18.262334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:18.269282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.269737 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.270550 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.271171 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.395909 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:18.404788 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-87fd31d5-3b90-483d-9a98-b88c1de84e52 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 200 len: 1226 microversion: 2.1 time: 0.147882 Aug 02 10:26:18.405372 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 518/1043] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:18 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:18.949465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:18.950130 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:18.956734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.957433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:18.958494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:18.958941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.171603 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:19.179488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d0bb552a-12c8-43ed-98d7-9072dc360bf1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.234125 Aug 02 10:26:19.180061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 526/1044] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:18 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:19.426520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:19.427116 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:19.433688 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.434208 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.434978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.435413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.449532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] HTTP exception thrown: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Request method failure captured: Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba HTTP/1.1 Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PsAdGMn_Omub4-Auu34OtG-j1a7ShrwnDm0PfhJ3EYZ-8UsspGOCuuVoMw5ggQGpoDRZqiKNsJSFRPyXGEnrk3D2dCPTQ8B3Bgf0kynMZ9YofDAA09_mAhhMkZAaMJclCdbQsXlh57zVLuOTTD0h9oCwqTX5SHORbjrcwmRMzk3tks Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:26:19.451216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/06660bbc73344c53b5a0337808514df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_06660bbc73344c53b5a0337808514df7", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-TestVolumeBootPattern-60672759 Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: e08bc25f122445f592652671790cc658 Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:26:19.452883 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'ca275f46-5c0d-4492-8ba8-e0b65fcc42ba'} Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:19.454048 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:26:19.455683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:19.457213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Returning 404 to user: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:19.457213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a6c907f8-5833-4d19-add6-7a7c9e8227ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 404 len: 111 microversion: 2.1 time: 0.030414 Aug 02 10:26:19.457213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 519/1045] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:19 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:26:19.555933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1459262298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2032059013", "security_groups": [{"name": "tempest-secgroup-smoke-49774062"}], "block_device_mapping_v2": [{"uuid": "1e9b005e-ee7e-4dc2-bdbb-8e51b08b1787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "535ee2bd-f985-461e-abca-68d048d5ab67"}]}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:19.716176 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] validate_networks() for [('535ee2bd-f985-461e-abca-68d048d5ab67', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:26:19.947707 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-b295100d-8b64-4822-bf49-2cf4f08b0578 req-48e708cf-1e91-4da0-b5fb-42556fd02eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05960c4f-ed10-44d8-9704-5ac44af34649", "tag": "d378a845-feaa-41ab-99d4-cbb059c1911e"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:19.958877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-b295100d-8b64-4822-bf49-2cf4f08b0578 req-48e708cf-1e91-4da0-b5fb-42556fd02eab service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:19.959314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-b295100d-8b64-4822-bf49-2cf4f08b0578 req-48e708cf-1e91-4da0-b5fb-42556fd02eab service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:19.971431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-b295100d-8b64-4822-bf49-2cf4f08b0578 req-48e708cf-1e91-4da0-b5fb-42556fd02eab service nova] Creating event network-changed:d378a845-feaa-41ab-99d4-cbb059c1911e for instance 05960c4f-ed10-44d8-9704-5ac44af34649 on hv-cinder-84713 Aug 02 10:26:19.977843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-b295100d-8b64-4822-bf49-2cf4f08b0578 req-48e708cf-1e91-4da0-b5fb-42556fd02eab service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035199 Aug 02 10:26:19.979624 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 520/1046] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:20.201001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:20.201703 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:20.207829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.208284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.209045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.209481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.486212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:26:20.486673 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:26:20.487334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:26:20.487814 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:26:20.488437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:26:20.498098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.498555 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.499384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:20.499819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:20.502843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:20.510579 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-55ca9930-b0fb-4537-a26d-4aad84ff035b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.313714 Aug 02 10:26:20.511433 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 521/1047] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:20 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:20.517741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for project 06660bbc73344c53b5a0337808514df7. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:26:20.521690 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for user e08bc25f122445f592652671790cc658 and project 06660bbc73344c53b5a0337808514df7. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:26:20.580417 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:26:20.582703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e9b005e-ee7e-4dc2-bdbb-8e51b08b1787',volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:26:20.715946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-651c6233-5482-4e17-a351-585cfffb0b6e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.164309 Aug 02 10:26:20.716501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 527/1048] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:26:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:26:20.727471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d0a95cd7-c6fc-41f8-acb2-ac1dab143f80 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:20.728204 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d0a95cd7-c6fc-41f8-acb2-ac1dab143f80 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:20.796497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d0a95cd7-c6fc-41f8-acb2-ac1dab143f80 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:20.803064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d0a95cd7-c6fc-41f8-acb2-ac1dab143f80 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1095 microversion: 2.1 time: 0.079623 Aug 02 10:26:20.803622 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 522/1049] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:20 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:21.531757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:21.532362 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:21.534383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:21.539955 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.540410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.541183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.541625 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.672458 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:21.680839 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4fb45ac9-ea0d-4d11-ac4e-29e9995b114c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.153310 Aug 02 10:26:21.681407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 528/1050] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:21 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:21.824136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:21.824680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:21.831811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.832266 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.833026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:21.833465 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:21.895105 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:21.910452 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-20fef1c7-4546-4df3-8d6e-27baf852a8f1 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1145 microversion: 2.1 time: 0.090845 Aug 02 10:26:21.911019 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 523/1051] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:21 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:22.701890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:22.702441 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:22.708903 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.709354 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.710148 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.710586 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.840351 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:22.847861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-96721635-5af3-4aac-a771-4bfec4b32526 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.149953 Aug 02 10:26:22.848431 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 529/1052] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:22 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:22.931596 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:22.932215 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:22.938720 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.939171 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:22.939937 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:22.940375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:23.000875 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:23.009076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d9aa24fb-2d56-4a31-91c2-8cba912e4943 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1145 microversion: 2.1 time: 0.080801 Aug 02 10:26:23.009653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 524/1053] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:22 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:23.868353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:23.869076 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:23.875773 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:23.876488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:23.877276 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:23.877716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:24.030877 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:24.032017 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:24.040148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:24.040879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:24.041726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:24.042380 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:24.079688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:24.087735 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2066ca11-ae3f-4a32-b319-5c68c402348c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.223196 Aug 02 10:26:24.088300 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 530/1054] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:23 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:24.122657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:24.130181 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3928e2ae-9717-4da2-b6b0-2bfe9da7b5e0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1211 microversion: 2.1 time: 0.104480 Aug 02 10:26:24.130837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 525/1055] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:24 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:25.109177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:25.109820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:25.116390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.116847 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.117620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.118088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.152045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:25.152600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:25.163450 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.163735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.164551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.165238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.397997 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:25.407022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-03d819ab-2eea-4dc6-aa65-c58e9d50999c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.301590 Aug 02 10:26:25.407678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 531/1056] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:25 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:25.435430 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:25.444701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d1b8ce57-77c1-46e3-85f8-a947f2e42dda tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.297312 Aug 02 10:26:25.446441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 526/1057] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:25 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:25.484689 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-d00dad95-0f36-422d-92c1-ec6bbac42832 req-34578c83-e044-4a4d-ad2e-c57ba930a137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c5efe2-a517-4412-9f74-c78d30243786", "tag": "3d7c67d0-4abc-46a6-b841-3085b992a63a"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:25.494681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-d00dad95-0f36-422d-92c1-ec6bbac42832 req-34578c83-e044-4a4d-ad2e-c57ba930a137 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:25.495144 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-d00dad95-0f36-422d-92c1-ec6bbac42832 req-34578c83-e044-4a4d-ad2e-c57ba930a137 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:25.506781 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-d00dad95-0f36-422d-92c1-ec6bbac42832 req-34578c83-e044-4a4d-ad2e-c57ba930a137 service nova] Creating event network-changed:3d7c67d0-4abc-46a6-b841-3085b992a63a for instance 28c5efe2-a517-4412-9f74-c78d30243786 on hv-cinder-84713 Aug 02 10:26:25.512867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-d00dad95-0f36-422d-92c1-ec6bbac42832 req-34578c83-e044-4a4d-ad2e-c57ba930a137 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Aug 02 10:26:25.513834 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 532/1058] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:26.428223 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:26.428897 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:26.435708 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.436166 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.437060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.437506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.467645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:26.468348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:26.474676 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.475131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.475905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.476344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.546075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:26.678643 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:26.683688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:26.687918 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-dcf2726c-42ce-4efc-9782-f8c7e48750a3 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.263555 Aug 02 10:26:26.692199 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 527/1059] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:26 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:26.695078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c0bebf98-1659-48dc-8ddf-253c79f0b8f9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.231724 Aug 02 10:26:26.696236 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 533/1060] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:26 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:26.742611 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-6ca4067b-2a6b-4072-ad1b-389360c87ac1 req-da2f0459-d015-4495-bae2-1c091513b1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05960c4f-ed10-44d8-9704-5ac44af34649", "name": "network-vif-plugged", "status": "completed", "tag": "d378a845-feaa-41ab-99d4-cbb059c1911e"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:26.752998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-6ca4067b-2a6b-4072-ad1b-389360c87ac1 req-da2f0459-d015-4495-bae2-1c091513b1c9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:26.753457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-6ca4067b-2a6b-4072-ad1b-389360c87ac1 req-da2f0459-d015-4495-bae2-1c091513b1c9 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:26.765310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-6ca4067b-2a6b-4072-ad1b-389360c87ac1 req-da2f0459-d015-4495-bae2-1c091513b1c9 service nova] Creating event network-vif-plugged:d378a845-feaa-41ab-99d4-cbb059c1911e for instance 05960c4f-ed10-44d8-9704-5ac44af34649 on hv-cinder-84713 Aug 02 10:26:26.770354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-6ca4067b-2a6b-4072-ad1b-389360c87ac1 req-da2f0459-d015-4495-bae2-1c091513b1c9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Aug 02 10:26:26.770951 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 528/1061] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:27.708420 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:27.709036 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:27.716390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.716840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.717098 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:27.717610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.717820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:27.718080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.724593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.725063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.725826 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:27.726269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:27.916093 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:27.920721 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:27.923724 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-eee31950-f28d-4c5a-8de9-4483a842065a tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.219154 Aug 02 10:26:27.924307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 534/1062] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:27 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:27.929330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-87749046-909d-4ea9-8d55-e87db2d59450 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.216997 Aug 02 10:26:27.929948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 529/1063] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:27 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:28.944725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:28.945529 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:28.950657 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:28.951307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:28.952004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:28.952463 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:28.953244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:28.953683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:28.957518 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:28.957995 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:28.958766 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:28.959202 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.153038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:29.160976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2c23eaf2-71b2-4b46-9959-40aa3d2740ae tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1315 microversion: 2.1 time: 0.220230 Aug 02 10:26:29.161263 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:29.161542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 535/1064] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:28 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:29.171559 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f62d8085-9454-40aa-9ca3-c437e10aaac3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.224682 Aug 02 10:26:29.172252 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 530/1065] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:28 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:29.829978 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:29.832170 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:29.842429 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.842885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.843660 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.844103 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.872162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-37aa7a2e-85a0-4ff4-a7b0-f65bd0c20400 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046192 Aug 02 10:26:29.872703 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 536/1066] 10.222.0.82 () {60 vars in 1343 bytes} [Tue Aug 2 10:26:29 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:29.933088 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:29.933605 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:29.939646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.940095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.940853 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:29.941286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:29.967064 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:26:30.043615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6c3a05f4-dd17-463f-9598-5906fbc99104 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 204 len: 0 microversion: 2.20 time: 0.114036 Aug 02 10:26:30.044255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 531/1067] 10.222.0.82 () {60 vars in 1280 bytes} [Tue Aug 2 10:26:29 2022] DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 10:26:30.052409 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.053012 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.059976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.060433 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.061206 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.061650 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.183373 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.184197 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.190540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.190996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.191432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:30.191773 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.192471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.194301 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:30.202622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:30.204308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:30.205765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e889fa81-c5eb-46e4-ab3e-734a32fc7e5b tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.157238 Aug 02 10:26:30.206353 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 537/1068] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:30 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:26:30.211030 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.211643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.218032 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.218750 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.219573 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.220018 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.389411 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:30.396996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-60108bfc-8c70-4657-b3b0-a8c2112a609b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1465 microversion: 2.1 time: 0.218385 Aug 02 10:26:30.397576 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 532/1069] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:30 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:30.407706 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:30.415386 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cc336bf6-5d13-441e-bd53-ac212753b014 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.208061 Aug 02 10:26:30.415951 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 538/1070] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:30 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:30.445628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.446174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.452647 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.453096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.453895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.454333 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.469586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:30.481705 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:26:30.553912 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3fc44239-9466-476c-8c36-52e710a2e146 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "DELETE /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 204 len: 0 microversion: 2.1 time: 0.112081 Aug 02 10:26:30.554501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 533/1071] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:26:30 2022] DELETE /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:26:30.562701 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:30.563282 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:30.565085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:30.565746 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=8 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:30.571729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.572678 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.573440 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:30.573904 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:30.702470 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:30.709890 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4a6f812d-26a1-4b3c-b461-e817b6468df1 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1471 microversion: 2.1 time: 0.151125 Aug 02 10:26:30.710457 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 539/1072] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:30 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:31.230627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:31.231384 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:31.233411 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=8 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:26:31.239222 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.239670 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.240434 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.240870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.373641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:31.381632 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:31.383297 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:31.384551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2eec516c-ed16-4cd4-875b-283ff8ece058 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.158839 Aug 02 10:26:31.385107 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 534/1073] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:31 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:26:31.436699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:31.437322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:31.444061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.444517 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.445289 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.445759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.574368 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:31.581920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d2762c9d-f658-4267-a086-4f518a360d33 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.149079 Aug 02 10:26:31.582481 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 540/1074] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:31 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:31.730639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:31.731259 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:31.737313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.737812 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.738564 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:31.739001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:31.876437 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:31.884005 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bd69c4e2-503d-42c5-a27a-4b820c273083 tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1471 microversion: 2.1 time: 0.157902 Aug 02 10:26:31.885075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 535/1075] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:31 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:32.406881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:32.407496 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:32.413556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.414041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.414810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.415246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.543134 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:32.551026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:32.552521 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:32.553683 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0cffaa87-fae1-4d2a-bd31-6198e6f69dc5 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.150854 Aug 02 10:26:32.554271 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 541/1076] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:32 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:26:32.602700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:32.604175 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:32.610722 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.611176 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.611944 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.612385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.741675 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:32.749678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1f29c652-3d0d-4ede-a912-a022d6d8cb2e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.150787 Aug 02 10:26:32.750267 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 536/1077] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:32 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:32.904516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:32.905127 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:32.911227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.911672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:32.912428 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:32.912860 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.047741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:33.055199 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-48673f23-b65e-4182-90e2-349e72cbeb0b tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1471 microversion: 2.1 time: 0.154506 Aug 02 10:26:33.055761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 542/1078] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:32 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:33.577037 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:33.577652 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:33.583753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.584210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.584973 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.585416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.715455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:33.723369 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:33.724885 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:33.726071 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9d6f610a-34fd-4d65-977c-9b604b797b58 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.152937 Aug 02 10:26:33.726628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 537/1079] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:33 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:26:33.770050 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:33.770774 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:33.777199 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.777679 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.778492 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:33.778938 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:33.912967 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:33.920377 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-df60ab92-5315-4791-9b3d-ac4e7f3d4bd9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.154217 Aug 02 10:26:33.920945 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 543/1080] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:33 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:34.083378 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:34.083997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:34.090084 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.090540 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.091436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.091888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.222962 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:34.230979 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c93dfacd-2403-44c0-b5a3-8272747eee6c tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1471 microversion: 2.1 time: 0.157202 Aug 02 10:26:34.231543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 538/1081] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:34 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:34.748503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:34.749127 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:34.755049 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.755509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.756278 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.756725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.940608 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:34.941218 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:34.949939 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.950437 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:34.951207 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:34.951638 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.102807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:35.110905 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:35.112855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:35.114145 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c325d340-cbee-454a-bc11-42e87f7ec8e4 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1723 microversion: 2.20 time: 0.369540 Aug 02 10:26:35.114702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 544/1082] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:34 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:26:35.252558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:35.253313 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:35.260009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.260562 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.261407 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.261949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.288520 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:35.305745 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ed85433c-7425-4395-b73c-29a68fe627e3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.368995 Aug 02 10:26:35.307820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 539/1083] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:34 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:35.386701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-2d8d662e-6195-4046-b75f-c5db5c5f0f4f req-c03e639c-c44f-4c6a-b846-84f3f975d763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05960c4f-ed10-44d8-9704-5ac44af34649", "name": "network-vif-deleted", "tag": "d378a845-feaa-41ab-99d4-cbb059c1911e"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:35.387695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01fa66107e4f989712cd883265a296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3211253f9154419a7511b40e0d1e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:35.396682 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-853820fb-e5cb-46ae-9a8a-e756b9e07f6e tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 200 len: 1429 microversion: 2.1 time: 0.147928 Aug 02 10:26:35.396909 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-2d8d662e-6195-4046-b75f-c5db5c5f0f4f req-c03e639c-c44f-4c6a-b846-84f3f975d763 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:35.397339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-2d8d662e-6195-4046-b75f-c5db5c5f0f4f req-c03e639c-c44f-4c6a-b846-84f3f975d763 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:35.406730 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 545/1084] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:35 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:26:35.426953 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-2d8d662e-6195-4046-b75f-c5db5c5f0f4f req-c03e639c-c44f-4c6a-b846-84f3f975d763 service nova] Creating event network-vif-deleted:d378a845-feaa-41ab-99d4-cbb059c1911e for instance 05960c4f-ed10-44d8-9704-5ac44af34649 on hv-cinder-84713 Aug 02 10:26:35.432689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-2d8d662e-6195-4046-b75f-c5db5c5f0f4f req-c03e639c-c44f-4c6a-b846-84f3f975d763 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051264 Aug 02 10:26:35.433289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 540/1085] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:26:36.136740 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:36.137292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:36.143992 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.144444 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.145244 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.145680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.178817 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.179255 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.179699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lazy-loading 'fault' on Instance uuid 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:26:36.222769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:36.232502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:36.234015 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6890a8127e04092920cb1d31ab56d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23714720faaa4562b694d7e3fbda2c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:36.235348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cb574455-0386-413a-a358-c6281e1fb533 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 200 len: 1370 microversion: 2.20 time: 0.102598 Aug 02 10:26:36.235922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 546/1086] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:36 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:26:36.332240 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:36.333850 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:36.343656 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.344327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.345151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.345652 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.427840 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:36.428602 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] [instance: 05960c4f-ed10-44d8-9704-5ac44af34649] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:36.435243 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.435882 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.437107 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:36.437777 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:36.454039 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] HTTP exception thrown: Instance 05960c4f-ed10-44d8-9704-5ac44af34649 could not be found. Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Request method failure captured: Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 HTTP/1.1 Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6PvGogsDpHbrLiwa_vnOhWgy8yNTJ4K64cnM4O91xO7Vj6m8uOEd8SlGxeGh-zCaFLbs8t4sZt9k6uDmG5-HQrIJPS0AL2PgopWe5NH6oj8aEUJTNYzc8GtjauHDf9hLUjzCEvsZpI4-yqDo76hFJJfdv6YntRd9lFFtHp_C-OZE1ss Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: c3211253f9154419a7511b40e0d1e291 Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-VolumesNegativeTest-904956543 Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:26:36.455778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/c3211253f9154419a7511b40e0d1e291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/c3211253f9154419a7511b40e0d1e291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/c3211253f9154419a7511b40e0d1e291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_c3211253f9154419a7511b40e0d1e291", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-VolumesNegativeTest-904956543 Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: c3211253f9154419a7511b40e0d1e291 Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-VolumesNegativeTest-904956543 Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-VolumesNegativeTest-904956543-project Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 5a01fa66107e4f989712cd883265a296 Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-VolumesNegativeTest-904956543-project Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 05960c4f-ed10-44d8-9704-5ac44af34649 could not be found. Aug 02 10:26:36.457174 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '05960c4f-ed10-44d8-9704-5ac44af34649'} Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05960c4f-ed10-44d8-9704-5ac44af34649 could not be found. Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:36.458010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05960c4f-ed10-44d8-9704-5ac44af34649 could not be found. Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05960c4f-ed10-44d8-9704-5ac44af34649 could not be found. Aug 02 10:26:36.459319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:36.467022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] Returning 404 to user: Instance 05960c4f-ed10-44d8-9704-5ac44af34649 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:36.467022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2554fe21-f860-4f6f-9fa3-9183f2d69ebf tempest-VolumesNegativeTest-904956543 tempest-VolumesNegativeTest-904956543-project] 10.222.0.82 "GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649" status: 404 len: 111 microversion: 2.1 time: 0.033258 Aug 02 10:26:36.467022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 547/1087] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:36 2022] GET /compute/v2.1/servers/05960c4f-ed10-44d8-9704-5ac44af34649 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:26:36.497542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:36.514978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2ab2b7a4-7cab-4eee-a738-5ab1a20bb0a5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.187497 Aug 02 10:26:36.519451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 541/1088] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:36 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:37.262900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:37.263531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:37.269993 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.270455 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.271235 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.271680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.285494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] HTTP exception thrown: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Request method failure captured: Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 HTTP/1.1 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pl01lMFi4_uZ6FkAfYb0Q6u9hg8WQmYFOTrmk5nhNI4ec6ZGuswGE_Ipa37kpj17_8D6S9cS3G9OfQIizz6e59xu0Tgb53Izq9WB9RG3-FIlRCBhowdFcXfuw_p50KUJRKnm5l90bqLICdjPfIy992c-gcetUXqNDqu2525dHIF260 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:26:37.287064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_23714720faaa4562b694d7e3fbda2c33", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b6890a8127e04092920cb1d31ab56d91 Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:37.288837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06'} Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:37.289638 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:37.291478 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:37.292646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Returning 404 to user: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:37.292646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-52c62dea-ff70-40e7-846a-d0943050281d tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 404 len: 111 microversion: 2.20 time: 0.030357 Aug 02 10:26:37.292646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 548/1089] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:37 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:26:37.298602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9267f06d-7a2d-40f8-a91b-ab4d82e91e1c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '.version_select at 0x7f5c03739af0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:37.318698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9267f06d-7a2d-40f8-a91b-ab4d82e91e1c tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753615440" status: 204 len: 0 microversion: 2.20 time: 0.024615 Aug 02 10:26:37.319263 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 542/1090] 10.222.0.82 () {60 vars in 1259 bytes} [Tue Aug 2 10:26:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753615440 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:26:37.450699 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-50422cde-0d8c-4944-9e9c-5dce40ea423f req-33c0a966-bb4f-4d58-8c6c-6a73bd7294f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06", "name": "network-vif-deleted", "tag": "69f4c65c-df92-4187-a34f-0970908d0332"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:37.460549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-50422cde-0d8c-4944-9e9c-5dce40ea423f req-33c0a966-bb4f-4d58-8c6c-6a73bd7294f8 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.461218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-50422cde-0d8c-4944-9e9c-5dce40ea423f req-33c0a966-bb4f-4d58-8c6c-6a73bd7294f8 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.476208 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-50422cde-0d8c-4944-9e9c-5dce40ea423f req-33c0a966-bb4f-4d58-8c6c-6a73bd7294f8 service nova] Creating event network-vif-deleted:69f4c65c-df92-4187-a34f-0970908d0332 for instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 on hv-cinder-84713 Aug 02 10:26:37.482759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-50422cde-0d8c-4944-9e9c-5dce40ea423f req-33c0a966-bb4f-4d58-8c6c-6a73bd7294f8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035600 Aug 02 10:26:37.484258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 549/1091] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:37.544490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:37.545403 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:37.554723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.555228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.556193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:37.556469 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:37.736562 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:37.750851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e9e8d92e-4a40-40a9-8973-8f16a4fc97ce tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.214107 Aug 02 10:26:37.751458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 543/1092] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:37 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:38.772788 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:38.773744 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:38.780958 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.781741 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.782583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.783451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.824660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-9fada57e-faf5-4a9a-b12d-6d50f78d31b4 req-050757f0-2682-4ea4-b24d-896e706c1b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c5efe2-a517-4412-9f74-c78d30243786", "name": "network-vif-plugged", "status": "completed", "tag": "3d7c67d0-4abc-46a6-b841-3085b992a63a"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:38.836753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-9fada57e-faf5-4a9a-b12d-6d50f78d31b4 req-050757f0-2682-4ea4-b24d-896e706c1b09 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:38.838057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-9fada57e-faf5-4a9a-b12d-6d50f78d31b4 req-050757f0-2682-4ea4-b24d-896e706c1b09 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:38.855214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-9fada57e-faf5-4a9a-b12d-6d50f78d31b4 req-050757f0-2682-4ea4-b24d-896e706c1b09 service nova] Creating event network-vif-plugged:3d7c67d0-4abc-46a6-b841-3085b992a63a for instance 28c5efe2-a517-4412-9f74-c78d30243786 on hv-cinder-84713 Aug 02 10:26:38.860328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-9fada57e-faf5-4a9a-b12d-6d50f78d31b4 req-050757f0-2682-4ea4-b24d-896e706c1b09 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042436 Aug 02 10:26:38.861060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 544/1093] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:26:38.944257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:38.953702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4c304849-a256-4848-ab62-b7cb7a461468 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.185672 Aug 02 10:26:38.954881 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 550/1094] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:38 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:39.175817 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:39.176415 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:39.183287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.183760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.184538 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.184976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.200002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] HTTP exception thrown: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Request method failure captured: Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 HTTP/1.1 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pl01lMFi4_uZ6FkAfYb0Q6u9hg8WQmYFOTrmk5nhNI4ec6ZGuswGE_Ipa37kpj17_8D6S9cS3G9OfQIizz6e59xu0Tgb53Izq9WB9RG3-FIlRCBhowdFcXfuw_p50KUJRKnm5l90bqLICdjPfIy992c-gcetUXqNDqu2525dHIF260 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:26:39.201712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_23714720faaa4562b694d7e3fbda2c33", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: b6890a8127e04092920cb1d31ab56d91 Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.203395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06'} Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:39.204338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.205868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.207282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Returning 404 to user: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:39.207282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c114bca0-f520-473a-8866-e38731b70ef2 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 404 len: 111 microversion: 2.20 time: 0.031766 Aug 02 10:26:39.207282 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 545/1095] 10.222.0.82 () {60 vars in 1280 bytes} [Tue Aug 2 10:26:39 2022] DELETE /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:26:39.211920 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:39.212579 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:39.219018 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.219769 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.220558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.221135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.236873 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] HTTP exception thrown: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Request method failure captured: Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 HTTP/1.1 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pl01lMFi4_uZ6FkAfYb0Q6u9hg8WQmYFOTrmk5nhNI4ec6ZGuswGE_Ipa37kpj17_8D6S9cS3G9OfQIizz6e59xu0Tgb53Izq9WB9RG3-FIlRCBhowdFcXfuw_p50KUJRKnm5l90bqLICdjPfIy992c-gcetUXqNDqu2525dHIF260 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:26:39.238591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_23714720faaa4562b694d7e3fbda2c33", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b6890a8127e04092920cb1d31ab56d91 Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.240370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06'} Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:39.241460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. Aug 02 10:26:39.243010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:39.244944 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Returning 404 to user: Instance 61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:39.245574 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7af13f7f-880b-481f-82f0-d047e0b6fcd1 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06" status: 404 len: 111 microversion: 2.20 time: 0.037537 Aug 02 10:26:39.246228 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 551/1096] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:39 2022] GET /compute/v2.1/servers/61a3bc1d-63e0-48f3-99cc-2ee5ba3e1a06 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:26:39.975142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:39.975760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:39.982898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.983350 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:39.984118 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:39.984556 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.124388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:40.132287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-16c6d8f2-4377-4149-90a5-1b5374a41715 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1265 microversion: 2.1 time: 0.161010 Aug 02 10:26:40.132870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 546/1097] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:39 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:40.391891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:40.392397 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:40.398850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.399305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.401184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.402013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.417536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] HTTP exception thrown: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Request method failure captured: Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 HTTP/1.1 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Pl01lMFi4_uZ6FkAfYb0Q6u9hg8WQmYFOTrmk5nhNI4ec6ZGuswGE_Ipa37kpj17_8D6S9cS3G9OfQIizz6e59xu0Tgb53Izq9WB9RG3-FIlRCBhowdFcXfuw_p50KUJRKnm5l90bqLICdjPfIy992c-gcetUXqNDqu2525dHIF260 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:26:40.419128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_23714720faaa4562b694d7e3fbda2c33", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: b6890a8127e04092920cb1d31ab56d91 Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.420959 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'f67576fd-f413-48a6-b4ca-401e450e7f14'} Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:40.421971 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.423504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.425078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Returning 404 to user: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:40.425078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6526032e-9ccf-4eca-b2f3-28a7fc695056 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 404 len: 111 microversion: 2.20 time: 0.032484 Aug 02 10:26:40.425078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 552/1098] 10.222.0.82 () {60 vars in 1280 bytes} [Tue Aug 2 10:26:40 2022] DELETE /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:26:40.429072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:40.429689 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] [instance: f67576fd-f413-48a6-b4ca-401e450e7f14] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:40.437553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.438187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.438969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:40.439419 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:40.455792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] HTTP exception thrown: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Request method failure captured: Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 HTTP/1.1 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Pl01lMFi4_uZ6FkAfYb0Q6u9hg8WQmYFOTrmk5nhNI4ec6ZGuswGE_Ipa37kpj17_8D6S9cS3G9OfQIizz6e59xu0Tgb53Izq9WB9RG3-FIlRCBhowdFcXfuw_p50KUJRKnm5l90bqLICdjPfIy992c-gcetUXqNDqu2525dHIF260 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:26:40.457497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/23714720faaa4562b694d7e3fbda2c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_23714720faaa4562b694d7e3fbda2c33", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 23714720faaa4562b694d7e3fbda2c33 Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1765009617 Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: b6890a8127e04092920cb1d31ab56d91 Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1765009617-project Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.459294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'f67576fd-f413-48a6-b4ca-401e450e7f14'} Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:26:40.460229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. Aug 02 10:26:40.461704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:26:40.463141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] Returning 404 to user: Instance f67576fd-f413-48a6-b4ca-401e450e7f14 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:26:40.463141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5c424979-ea71-40c6-8c2c-74e376135069 tempest-AttachVolumeShelveTestJSON-1765009617 tempest-AttachVolumeShelveTestJSON-1765009617-project] 10.222.0.82 "GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14" status: 404 len: 111 microversion: 2.20 time: 0.033795 Aug 02 10:26:40.463141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 547/1099] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Aug 2 10:26:40 2022] GET /compute/v2.1/servers/f67576fd-f413-48a6-b4ca-401e450e7f14 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:26:41.163070 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:41.163607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:41.170658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.171110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.171910 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.172523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.412102 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:41.421169 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e9b28a30-6713-4399-847f-f9cd851b63b5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1452 microversion: 2.1 time: 0.262176 Aug 02 10:26:41.422008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 553/1100] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:41 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1452 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:41.442991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:26:41.443837 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:26:41.451544 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.452000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.453023 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:41.453466 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:41.669114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:26:41.677617 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ef655d35-46d1-4537-94a8-49320988dfc3 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1452 microversion: 2.1 time: 0.239462 Aug 02 10:26:41.678586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 548/1101] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:26:41 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:26:44.811432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-56136999-6063-40ff-ab54-2f4ca61fc936 req-c9d5ddee-e2f9-4c88-a3f8-35dbf384016f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c5efe2-a517-4412-9f74-c78d30243786", "tag": "3d7c67d0-4abc-46a6-b841-3085b992a63a"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:26:44.829711 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-56136999-6063-40ff-ab54-2f4ca61fc936 req-c9d5ddee-e2f9-4c88-a3f8-35dbf384016f service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:26:44.830187 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-56136999-6063-40ff-ab54-2f4ca61fc936 req-c9d5ddee-e2f9-4c88-a3f8-35dbf384016f service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:26:44.842712 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-56136999-6063-40ff-ab54-2f4ca61fc936 req-c9d5ddee-e2f9-4c88-a3f8-35dbf384016f service nova] Creating event network-changed:3d7c67d0-4abc-46a6-b841-3085b992a63a for instance 28c5efe2-a517-4412-9f74-c78d30243786 on hv-cinder-84713 Aug 02 10:26:44.854916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-56136999-6063-40ff-ab54-2f4ca61fc936 req-c9d5ddee-e2f9-4c88-a3f8-35dbf384016f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047784 Aug 02 10:26:44.855526 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 554/1102] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:04.984809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:04.985593 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:04.989771 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:04.990291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:04.997829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.998284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:04.999056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:04.999560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.025724 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cea94357-3009-4dba-8919-502dd6158e3f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/ips" status: 200 len: 150 microversion: 2.1 time: 0.042828 Aug 02 10:28:05.026895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 549/1103] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:28:04 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:05.037434 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=55 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:05.038264 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=81 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:05.043258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3981f3-8314-440f-9c3f-c41649226cb3"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:05.045649 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:05.052681 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.053133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.053932 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.054384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.140624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Invalid volume: volume 6a3981f3-8314-440f-9c3f-c41649226cb3 is already attached to instances: e023bb92-5fed-496c-a500-1d424eb6621d Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: POST /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/os-volume_attachments HTTP/1.1 Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 74 Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:28:05.142402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {"volumeAttachment": {"volumeId": "6a3981f3-8314-440f-9c3f-c41649226cb3"}} Aug 02 10:28:05.145163 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Invalid volume: volume 6a3981f3-8314-440f-9c3f-c41649226cb3 is already attached to instances: e023bb92-5fed-496c-a500-1d424eb6621d Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'server_id': '7fc26b90-7065-470e-b612-ceef2e8f497d', 'body': {'volumeAttachment': {'volumeId': '6a3981f3-8314-440f-9c3f-c41649226cb3'}}} Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6a3981f3-8314-440f-9c3f-c41649226cb3 is already attached to instances: e023bb92-5fed-496c-a500-1d424eb6621d Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:05.146227 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6a3981f3-8314-440f-9c3f-c41649226cb3 is already attached to instances: e023bb92-5fed-496c-a500-1d424eb6621d Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:05.147871 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6a3981f3-8314-440f-9c3f-c41649226cb3 is already attached to instances: e023bb92-5fed-496c-a500-1d424eb6621d Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 400 to user: Invalid volume: volume 6a3981f3-8314-440f-9c3f-c41649226cb3 is already attached to instances: e023bb92-5fed-496c-a500-1d424eb6621d {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a77d87dc-3198-483b-a86a-89f5449630fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108451 Aug 02 10:28:05.149980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 555/1104] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:28:05 2022] POST /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:28:05.153005 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:05.153562 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:05.159758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.160214 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.160991 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.161431 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.191521 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:28:05.265230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7587ecef-35f5-434c-8e9e-6de4bc0c1d6e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 204 len: 0 microversion: 2.1 time: 0.115991 Aug 02 10:28:05.265899 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 550/1105] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:28:05 2022] DELETE /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:28:05.274295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:05.274915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:05.281949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.282412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.283190 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:05.283629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:05.680246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:05.689006 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-25f0a893-e2fb-4930-af80-6ef1693e3a4d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1682 microversion: 2.1 time: 0.418557 Aug 02 10:28:05.689608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 556/1106] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:05 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1682 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:06.711021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:06.711715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:06.719193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:06.719639 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.720413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:06.720919 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:06.850660 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:06.859396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-18934af7-d53a-4cb1-9b7a-24b24d0a615f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1682 microversion: 2.1 time: 0.152583 Aug 02 10:28:06.860271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 551/1107] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:06 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:07.884537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:07.885072 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:07.892818 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.893279 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:07.894122 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:07.894564 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.157429 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:08.165419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-9f3f60c7-68eb-4f7d-a2c0-b992e59096bb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 200 len: 1682 microversion: 2.1 time: 0.287634 Aug 02 10:28:08.166104 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 557/1108] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:07 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 1682 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:08.569481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-b908fce7-6b2d-4763-aacf-85adbd3c803c req-30ae03b4-7901-4ee3-a712-0a259e407109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc26b90-7065-470e-b612-ceef2e8f497d", "name": "network-vif-deleted", "tag": "1d31ada3-b1d3-4ceb-88db-e7ccbe291f70"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:08.587686 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-b908fce7-6b2d-4763-aacf-85adbd3c803c req-30ae03b4-7901-4ee3-a712-0a259e407109 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:08.590753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-b908fce7-6b2d-4763-aacf-85adbd3c803c req-30ae03b4-7901-4ee3-a712-0a259e407109 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:08.605317 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-b908fce7-6b2d-4763-aacf-85adbd3c803c req-30ae03b4-7901-4ee3-a712-0a259e407109 service nova] Creating event network-vif-deleted:1d31ada3-b1d3-4ceb-88db-e7ccbe291f70 for instance 7fc26b90-7065-470e-b612-ceef2e8f497d on hv-cinder-84713 Aug 02 10:28:08.610679 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-b908fce7-6b2d-4763-aacf-85adbd3c803c req-30ae03b4-7901-4ee3-a712-0a259e407109 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233506 Aug 02 10:28:08.611913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 552/1109] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:09.186993 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:09.187972 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:09.195135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.195669 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.196555 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.197204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.212004 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d HTTP/1.1 Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:28:09.214019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:28:09.217356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '7fc26b90-7065-470e-b612-ceef2e8f497d'} Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:28:09.218257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:28:09.219949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:09.222044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:28:09.222044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-85cbae83-737a-47ba-9f9c-ab0ff7866baf tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 404 len: 111 microversion: 2.1 time: 0.033459 Aug 02 10:28:09.222044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 558/1110] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:09 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:28:09.226497 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-977f4a1c-61e7-4953-b157-c98597eb8ee7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '.version_select at 0x7f5c0353d1f0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:09.248711 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-977f4a1c-61e7-4953-b157-c98597eb8ee7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087033479" status: 202 len: 0 microversion: 2.1 time: 0.027304 Aug 02 10:28:09.249298 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 553/1111] 10.222.0.82 () {58 vars in 1221 bytes} [Tue Aug 2 10:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087033479 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:28:09.979767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:09.980264 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:09.986239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.986696 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:09.987464 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:09.987902 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.069572 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lazy-loading 'services' on Instance uuid e023bb92-5fed-496c-a500-1d424eb6621d {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:28:10.164216 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8827232e-be81-4356-8fd5-f62f059fc11a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments/6a3981f3-8314-440f-9c3f-c41649226cb3" status: 202 len: 0 microversion: 2.1 time: 0.188318 Aug 02 10:28:10.165100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 559/1112] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:28:09 2022] DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments/6a3981f3-8314-440f-9c3f-c41649226cb3 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:28:10.177053 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:10.180731 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:10.191987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.193066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.194050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:10.194495 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:10.231001 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c1911cbf-e8b9-4c67-a4ae-fefa8fd44da4 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060542 Aug 02 10:28:10.231556 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 554/1113] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:10 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:11.244446 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:11.247972 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:11.253989 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.254448 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.255233 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:11.255672 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:11.286872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8f6d0ee2-2039-4a0e-acb4-420f086e6578 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 Aug 02 10:28:11.287406 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 560/1114] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:11 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:12.299230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:12.301377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:12.307866 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.308314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.309075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.309508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.338034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b020bec9-dd11-424f-b58b-9dcc16c8e038 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042850 Aug 02 10:28:12.338584 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 555/1115] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:28:12 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:28:12.399418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:12.400014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:12.407257 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.407743 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.408506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.408946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.433523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:28:12.517382 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-65654a54-494f-4c28-8337-a524db03c145 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 204 len: 0 microversion: 2.1 time: 0.121608 Aug 02 10:28:12.518121 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 561/1116] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:28:12 2022] DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:28:12.526334 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:12.527094 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:12.534780 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.535321 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.536077 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:12.536507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:12.675624 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:12.683492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-798a4b82-7cf3-4427-b3ee-f2c058bfce6d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1679 microversion: 2.1 time: 0.161207 Aug 02 10:28:12.684060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 556/1117] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:12 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:13.706275 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:13.707086 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:13.713721 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.714294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.715135 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:13.715633 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:13.850419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:13.857007 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f1dd8d33-eef0-40e9-8cce-e27ae805cdfb tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1679 microversion: 2.1 time: 0.154984 Aug 02 10:28:13.857564 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 562/1118] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:13 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:14.879386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:14.879999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:14.886617 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.887423 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:14.888320 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:14.888921 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.149706 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:15.157954 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-eb99bcf8-18c6-4bf0-9fde-d7497e1af675 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1679 microversion: 2.1 time: 0.282520 Aug 02 10:28:15.158539 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 557/1119] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:14 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1679 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:15.614734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-56e43dc4-2e56-4a29-b8ac-a51f151e799d req-bcec8388-5b9b-4e57-9e13-17743d720697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e023bb92-5fed-496c-a500-1d424eb6621d", "name": "network-vif-deleted", "tag": "165dd833-be3f-4680-b710-242e36dcdfa1"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:15.624936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-56e43dc4-2e56-4a29-b8ac-a51f151e799d req-bcec8388-5b9b-4e57-9e13-17743d720697 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:15.625383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-56e43dc4-2e56-4a29-b8ac-a51f151e799d req-bcec8388-5b9b-4e57-9e13-17743d720697 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:15.636656 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-56e43dc4-2e56-4a29-b8ac-a51f151e799d req-bcec8388-5b9b-4e57-9e13-17743d720697 service nova] Creating event network-vif-deleted:165dd833-be3f-4680-b710-242e36dcdfa1 for instance e023bb92-5fed-496c-a500-1d424eb6621d on hv-cinder-84713 Aug 02 10:28:15.641451 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-56e43dc4-2e56-4a29-b8ac-a51f151e799d req-bcec8388-5b9b-4e57-9e13-17743d720697 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Aug 02 10:28:15.642412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 563/1120] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:16.180457 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:16.181247 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:16.188851 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.189412 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.190597 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.191134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.224141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:16.224592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:16.225244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lazy-loading 'fault' on Instance uuid e023bb92-5fed-496c-a500-1d424eb6621d {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:28:16.273229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:16.281832 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3675fe73-1d6b-4079-a0be-d8c0bc4a34e3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 200 len: 1330 microversion: 2.1 time: 0.105453 Aug 02 10:28:16.282491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 558/1121] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:16 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:17.304937 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:17.305641 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:17.312360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.312812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.313574 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:17.314041 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:17.328138 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d HTTP/1.1 Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:28:17.329756 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:28:17.332838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'e023bb92-5fed-496c-a500-1d424eb6621d'} Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:28:17.334117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:28:17.337950 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:28:17.341128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:28:17.341128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d31ab825-3886-468c-8dc8-e6f493b04202 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 404 len: 111 microversion: 2.1 time: 0.030975 Aug 02 10:28:17.341128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 564/1122] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:17 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:28:17.341592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5ce3d04c-a559-4d90-bcda-47c217b2d078 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '.version_select at 0x7f5c037f04c0>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:17.361748 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5ce3d04c-a559-4d90-bcda-47c217b2d078 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885852708" status: 202 len: 0 microversion: 2.1 time: 0.024638 Aug 02 10:28:17.362367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 559/1123] 10.222.0.82 () {58 vars in 1218 bytes} [Tue Aug 2 10:28:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885852708 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:28:17.984984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3bbedd8f-56f9-4dc8-8353-7fd61b30d6ac tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: .version_select at 0x7f5c08099ee0>, body: {"keypair": {"name": "tempest-keypair-1111570097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPyFTENuZxYGu/yJQKtLuNt8ewiAGJVWCanlxGY+L8dWpTR7PZnwiGAw602dnB2JpHifMe9936CCH2J/9+/u3a8jN4MR2faH8gDKmPYn2XIVtnZpn73A/V0UumwIBg/sA=="}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:17.999568 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-3bbedd8f-56f9-4dc8-8353-7fd61b30d6ac tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:28:18.003203 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-3bbedd8f-56f9-4dc8-8353-7fd61b30d6ac tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:28:18.027286 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3bbedd8f-56f9-4dc8-8353-7fd61b30d6ac tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046465 Aug 02 10:28:18.027857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 565/1124] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:28:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:19.329274 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-335231455", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c06faac-b7f7-48ef-b76d-6bd0b909a62b"}], "security_groups": [{"name": "tempest-securitygroup--390134587"}], "key_name": "tempest-keypair-1111570097", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:19.444018 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] validate_networks() for [('7c06faac-b7f7-48ef-b76d-6bd0b909a62b', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:28:19.942905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:28:19.943338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:28:19.943852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:28:19.944274 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:28:19.944690 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:28:19.954284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.954755 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.955577 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:19.956016 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:19.974330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:28:19.978235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:28:19.989291 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:28:19.991680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:28:20.053328 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-608cd055-76d6-43fc-ba65-ab20e3913bf7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728417 Aug 02 10:28:20.054210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 560/1125] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:28:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:28:20.066464 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-62220f2c-f559-4f88-9de2-e2a96e38a8c0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:20.067083 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-62220f2c-f559-4f88-9de2-e2a96e38a8c0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:20.152184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-62220f2c-f559-4f88-9de2-e2a96e38a8c0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:20.162017 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-62220f2c-f559-4f88-9de2-e2a96e38a8c0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1241 microversion: 2.1 time: 0.100283 Aug 02 10:28:20.175221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 566/1126] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:20 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:21.183335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:21.183886 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:21.190095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.190805 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.191570 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:21.192047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:21.256432 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:21.264141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0f3403b8-351d-4858-bb17-67596aa9eb2b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1293 microversion: 2.1 time: 0.085797 Aug 02 10:28:21.266331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 561/1127] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:21 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:22.080233 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1069317228", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "networks": [{"uuid": "5ff1c676-c46e-4ef1-8acf-896106b315a7"}]}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:22.134926 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.network.neutron [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] validate_networks() for [('5ff1c676-c46e-4ef1-8acf-896106b315a7', None, None, None, None, None)] {{(pid=118031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:28:22.285741 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:22.286313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:22.293348 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.293802 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.294566 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.295005 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.390849 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:22.398458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-60e01747-1e61-4103-bcb3-1373b71803d0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1299 microversion: 2.1 time: 0.116596 Aug 02 10:28:22.399217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 562/1128] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:22 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:22.831310 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Flavor limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:28:22.831811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Image limits 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:28:22.832359 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Flavor pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:28:22.832872 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Image pref 0:0:0 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:28:22.833381 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.virt.hardware [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:28:22.842092 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.842542 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.843344 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:22.843778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:22.860698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Getting quotas for project f99abdc12f9d404498711c2eb6c3363c. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:28:22.864620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Getting quotas for user 28db30abecd2452e89be5b3b89cc39e7 and project f99abdc12f9d404498711c2eb6c3363c. Resources: {'instances', 'cores', 'ram'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:28:22.876064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Going to run 1 instances... {{(pid=118031) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:28:22.878387 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:28:22.921877 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7e059269-9f40-4267-87fd-4ccaaee3dc36 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845565 Aug 02 10:28:22.922715 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 567/1129] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:28:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:28:22.933818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-576c9118-f497-4cba-9f8d-1504aa53d977 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:22.934435 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-576c9118-f497-4cba-9f8d-1504aa53d977 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:22.993416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-576c9118-f497-4cba-9f8d-1504aa53d977 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:23.001211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-576c9118-f497-4cba-9f8d-1504aa53d977 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1219 microversion: 2.1 time: 0.071828 Aug 02 10:28:23.001824 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 563/1130] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:22 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:23.327511 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-37bf4f02-de25-4dc9-a9ab-855d3e44395e req-78060e12-8566-4f04-8305-b74984fc42c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64d6553-8f47-403a-a644-70887989602b", "tag": "49319e0d-43b5-4132-83ac-34d3f899f8cd"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:23.341961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-37bf4f02-de25-4dc9-a9ab-855d3e44395e req-78060e12-8566-4f04-8305-b74984fc42c5 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.342853 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-37bf4f02-de25-4dc9-a9ab-855d3e44395e req-78060e12-8566-4f04-8305-b74984fc42c5 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.356483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-37bf4f02-de25-4dc9-a9ab-855d3e44395e req-78060e12-8566-4f04-8305-b74984fc42c5 service nova] Creating event network-changed:49319e0d-43b5-4132-83ac-34d3f899f8cd for instance e64d6553-8f47-403a-a644-70887989602b on hv-cinder-84713 Aug 02 10:28:23.361870 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-37bf4f02-de25-4dc9-a9ab-855d3e44395e req-78060e12-8566-4f04-8305-b74984fc42c5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040668 Aug 02 10:28:23.363002 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 568/1131] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:23.421313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:23.422796 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:23.431930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.432445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.433447 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:23.433923 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:23.621506 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:23.628839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cd87e046-1694-49e7-975a-2328bba0c77d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.212631 Aug 02 10:28:23.629396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 564/1132] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:23 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:24.022720 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:24.023663 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:24.030177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.030627 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.031591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.032260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.124238 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:24.131824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5edcdb37-6d84-43dd-8d99-a28790571160 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1277 microversion: 2.1 time: 0.113486 Aug 02 10:28:24.132474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 569/1133] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:24 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:24.655076 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:24.656356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:24.663507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.663994 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.664777 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:24.665216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:24.861340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:24.868827 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f4f8b8ce-3a88-4cea-b4b1-494e174dfb3e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.223136 Aug 02 10:28:24.869392 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 565/1134] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:24 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:25.153074 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:25.153628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:25.160707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.161158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.161984 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.162419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.298123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:25.310079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d84d41d3-91d8-4e8f-bf4d-0b2e047ef039 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.161479 Aug 02 10:28:25.310651 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 570/1135] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:25 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:25.890225 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:25.890832 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:25.897245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.897686 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:25.898481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:25.898911 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.030537 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:26.037905 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cbad9096-ad53-4521-a87a-dc54821901ee tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.151524 Aug 02 10:28:26.038468 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 566/1136] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:25 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:26.332389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:26.333022 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:26.339079 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.339534 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.340305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:26.340747 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:26.467707 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:26.475019 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-92554227-3dff-4841-9b2b-a9b5407176f6 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.146666 Aug 02 10:28:26.475607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 571/1137] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:26 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:27.060135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:27.060852 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:27.067747 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.068268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.069034 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.069467 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.398609 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:27.406404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-73ef4e83-426c-42c6-806c-706a7caaf8d8 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.350880 Aug 02 10:28:27.407079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 567/1138] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:27 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:27.497069 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:27.497855 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:27.504449 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.504897 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.505667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:27.506128 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:27.805670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:27.813134 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2d148b01-7bff-48dc-8af0-3186acfbe597 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.320589 Aug 02 10:28:27.813693 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 572/1139] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:27 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:28.427473 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-ff3f0fa8-7c60-4f77-85fa-136078dcb62c req-69541bb6-ec96-4f7c-8485-4b847a2dd74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8b37cd-9881-4f92-b287-792d03666d63", "tag": "cfabd496-bdc0-4edf-a51b-7734701c16f8"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:28.430853 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:28.431986 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:28.437569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ff3f0fa8-7c60-4f77-85fa-136078dcb62c req-69541bb6-ec96-4f7c-8485-4b847a2dd74e service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.438047 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-ff3f0fa8-7c60-4f77-85fa-136078dcb62c req-69541bb6-ec96-4f7c-8485-4b847a2dd74e service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.442338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:28.444962 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.445579 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.446411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.446856 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.451598 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-ff3f0fa8-7c60-4f77-85fa-136078dcb62c req-69541bb6-ec96-4f7c-8485-4b847a2dd74e service nova] Creating event network-changed:cfabd496-bdc0-4edf-a51b-7734701c16f8 for instance 0e8b37cd-9881-4f92-b287-792d03666d63 on hv-cinder-84713 Aug 02 10:28:28.456541 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-ff3f0fa8-7c60-4f77-85fa-136078dcb62c req-69541bb6-ec96-4f7c-8485-4b847a2dd74e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Aug 02 10:28:28.457152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 568/1140] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:28.673399 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:28.682020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d555baea-c063-44b7-a72d-ea0ce04a937c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.254986 Aug 02 10:28:28.683209 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 573/1141] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:28 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:28.834824 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:28.835759 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:28.842052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.842698 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.843736 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.844375 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.862930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-cabf2a04-20d9-4798-ba70-ac01989c815e req-62c0414f-7a3a-41ca-94b5-e6b849a1e572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64d6553-8f47-403a-a644-70887989602b", "name": "network-vif-plugged", "status": "completed", "tag": "49319e0d-43b5-4132-83ac-34d3f899f8cd"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:28.864629 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:28.873735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-cabf2a04-20d9-4798-ba70-ac01989c815e req-62c0414f-7a3a-41ca-94b5-e6b849a1e572 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:28.874478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-cabf2a04-20d9-4798-ba70-ac01989c815e req-62c0414f-7a3a-41ca-94b5-e6b849a1e572 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:28.888521 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-cabf2a04-20d9-4798-ba70-ac01989c815e req-62c0414f-7a3a-41ca-94b5-e6b849a1e572 service nova] Creating event network-vif-plugged:49319e0d-43b5-4132-83ac-34d3f899f8cd for instance e64d6553-8f47-403a-a644-70887989602b on hv-cinder-84713 Aug 02 10:28:28.893314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-cabf2a04-20d9-4798-ba70-ac01989c815e req-62c0414f-7a3a-41ca-94b5-e6b849a1e572 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171651 Aug 02 10:28:28.894163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 569/1142] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:29.012499 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:29.028294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-bf6b5842-b493-44be-9937-00a0c4288c43 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.194646 Aug 02 10:28:29.029230 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 574/1143] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:28 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:28:29.705216 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:29.705947 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:29.712164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.712616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.714114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:29.714555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:29.844864 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:29.852402 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ad568492-6356-486f-a49b-69e07fe3051d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.151962 Aug 02 10:28:29.852985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 570/1144] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:29 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:30.050686 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:30.051298 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:30.058315 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.058757 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.059514 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.059949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.186972 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:30.194548 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0af98354-ac2e-492b-932c-1b19388b35e9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.147767 Aug 02 10:28:30.195129 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 575/1145] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:30 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:30.874753 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:30.875376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:30.877456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:30.883451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.883904 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:30.884675 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:30.885669 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.019296 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:31.027560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0227cac1-eb45-4363-8247-1063306e95a2 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.156710 Aug 02 10:28:31.028131 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 571/1146] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:30 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:31.216181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:31.216728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:31.223162 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.223612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.224372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:31.224811 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:31.435931 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:31.443695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0c6f4bd7-fd27-48e5-addc-d90c5a215bf2 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.232018 Aug 02 10:28:31.444262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 576/1147] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:31 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:32.048423 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:32.049040 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:32.055850 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.056307 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.057080 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.057521 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.194381 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:32.201771 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-d0eb793f-57dd-44a1-8fc3-36dc72fabc40 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1366 microversion: 2.1 time: 0.157273 Aug 02 10:28:32.202362 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 572/1148] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:32 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:32.465010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:32.465632 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:32.472158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.472609 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.473370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:32.473831 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:32.626373 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:32.634172 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-57b34b3e-af4a-480f-9aa0-0d6f9fca84d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.173570 Aug 02 10:28:32.634939 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 577/1149] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:32 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:33.223330 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.223985 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.225873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=8 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:33.232197 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.232651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.233425 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.234002 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.367123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:33.375455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-656fb018-2a94-47b5-810e-df046b8b4398 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1555 microversion: 2.1 time: 0.156167 Aug 02 10:28:33.376038 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 573/1150] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:33.396820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.397442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.399474 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:33.400210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=12 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:33.406790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.408021 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.408460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.487728 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fd7216bb-0042-4d09-8671-d964e70e6a77 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095018 Aug 02 10:28:33.488331 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 578/1151] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:28:33.656448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:33.657070 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:33.663210 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.663661 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.664436 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:33.664876 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:33.907868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:33.915383 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9cf94a00-fe83-412f-ab53-7945dd372601 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.262771 Aug 02 10:28:33.916045 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 574/1152] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:33 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:34.488177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-255df7d2-8448-43d3-a586-7e7cf7de6067 req-59db8aba-e7e3-44c2-b714-cb7d45dc9a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64d6553-8f47-403a-a644-70887989602b", "tag": "49319e0d-43b5-4132-83ac-34d3f899f8cd"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:34.497469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-255df7d2-8448-43d3-a586-7e7cf7de6067 req-59db8aba-e7e3-44c2-b714-cb7d45dc9a03 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.497948 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-255df7d2-8448-43d3-a586-7e7cf7de6067 req-59db8aba-e7e3-44c2-b714-cb7d45dc9a03 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.509067 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-255df7d2-8448-43d3-a586-7e7cf7de6067 req-59db8aba-e7e3-44c2-b714-cb7d45dc9a03 service nova] Creating event network-changed:49319e0d-43b5-4132-83ac-34d3f899f8cd for instance e64d6553-8f47-403a-a644-70887989602b on hv-cinder-84713 Aug 02 10:28:34.514617 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-255df7d2-8448-43d3-a586-7e7cf7de6067 req-59db8aba-e7e3-44c2-b714-cb7d45dc9a03 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Aug 02 10:28:34.515225 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 579/1153] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:34.936681 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:34.938329 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:34.946052 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.946680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-c661ea5c-1e5c-4fdd-9480-156481c4ded9 req-666e3c29-d0a0-405b-9d35-4ddcfd465879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8b37cd-9881-4f92-b287-792d03666d63", "name": "network-vif-plugged", "status": "completed", "tag": "cfabd496-bdc0-4edf-a51b-7734701c16f8"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:28:34.947056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.948965 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.949621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.959610 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-c661ea5c-1e5c-4fdd-9480-156481c4ded9 req-666e3c29-d0a0-405b-9d35-4ddcfd465879 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:34.960057 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-c661ea5c-1e5c-4fdd-9480-156481c4ded9 req-666e3c29-d0a0-405b-9d35-4ddcfd465879 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:34.973980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-c661ea5c-1e5c-4fdd-9480-156481c4ded9 req-666e3c29-d0a0-405b-9d35-4ddcfd465879 service nova] Creating event network-vif-plugged:cfabd496-bdc0-4edf-a51b-7734701c16f8 for instance 0e8b37cd-9881-4f92-b287-792d03666d63 on hv-cinder-84713 Aug 02 10:28:34.983402 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-c661ea5c-1e5c-4fdd-9480-156481c4ded9 req-666e3c29-d0a0-405b-9d35-4ddcfd465879 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043916 Aug 02 10:28:34.986575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 580/1154] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:28:35.171633 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:35.182163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c19e85e5-36e5-48c5-809e-25c63a40cafb tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.249358 Aug 02 10:28:35.183980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 575/1155] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:34 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:36.205497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:36.206236 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:36.208118 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:36.213622 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.214090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.214842 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:36.215274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:36.343342 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:36.350727 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7037f210-17e6-4e07-9a10-81758ac3f772 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1319 microversion: 2.1 time: 0.149963 Aug 02 10:28:36.351281 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 581/1156] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:36 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:28:37.371888 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:28:37.372507 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:28:37.374881 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:28:37.380284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.380737 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.381505 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:28:37.381983 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:28:37.516095 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:28:37.523740 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-45a3ec9a-3506-4a44-a08e-f7157295ba13 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1508 microversion: 2.1 time: 0.155768 Aug 02 10:28:37.524310 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 576/1157] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:28:37 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:02.168645 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d7184af-818f-4137-a4b3-81434aadf96a", "device": "/dev/sdb"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:02.171583 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:02.174469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:02.175109 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=34 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:02.180639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.181091 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.181928 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:02.182401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:02.430768 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7ab435c6-dbe0-4b3e-b347-c0084b118798 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "POST /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266018 Aug 02 10:29:02.431494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 582/1158] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:29:02 2022] POST /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:13.277336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-690757206", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2032059013", "security_groups": [{"name": "tempest-secgroup-smoke-49774062"}], "block_device_mapping_v2": [{"uuid": "8dfa4e57-3da7-439d-9797-bde2e790249e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "535ee2bd-f985-461e-abca-68d048d5ab67"}]}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:13.287833 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:13.288475 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=44 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:13.392195 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] validate_networks() for [('535ee2bd-f985-461e-abca-68d048d5ab67', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:29:13.750958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:29:13.751393 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:29:13.751869 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:29:13.752280 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:29:13.752695 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:29:13.761632 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.762123 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.762925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:13.763359 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:13.781055 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for project 06660bbc73344c53b5a0337808514df7. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:29:13.785756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Getting quotas for user e08bc25f122445f592652671790cc658 and project 06660bbc73344c53b5a0337808514df7. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:29:13.847588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:29:13.851008 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dfa4e57-3da7-439d-9797-bde2e790249e',volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:29:13.985798 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cb841544-096e-488b-a8b7-f3a5a4602bf6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.712922 Aug 02 10:29:13.986456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 577/1159] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:29:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:29:13.995060 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:13.995981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:14.000363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-2fed62c7-ab70-4db1-9b77-d40bf9275e0e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:14.001590 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-2fed62c7-ab70-4db1-9b77-d40bf9275e0e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:14.060825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-2fed62c7-ab70-4db1-9b77-d40bf9275e0e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:14.068602 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-2fed62c7-ab70-4db1-9b77-d40bf9275e0e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1094 microversion: 2.1 time: 0.075053 Aug 02 10:29:14.069167 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 583/1160] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:13 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:15.090284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:15.090915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:15.098312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.098764 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.099532 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:15.099974 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:15.161274 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:15.168698 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-0398e7b8-515e-441e-9e36-474f64274344 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1200 microversion: 2.1 time: 0.082935 Aug 02 10:29:15.169262 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 578/1161] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:15 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:16.189322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:16.190173 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:16.197355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.197823 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.198584 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:16.199014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:16.258589 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:16.266073 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-00f06b35-08ee-4dbe-aa1b-69b63758aa24 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1200 microversion: 2.1 time: 0.080650 Aug 02 10:29:16.266628 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 584/1162] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:16 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:17.287229 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:17.287849 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:17.294390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.294843 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.295608 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:17.296051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:17.363592 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:17.371159 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9a12ca30-c1ee-461f-a8da-78ea1d125d53 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1210 microversion: 2.1 time: 0.088148 Aug 02 10:29:17.371726 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 579/1163] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:17 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:18.393024 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:18.393644 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:18.400204 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.400658 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.401427 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:18.401894 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:18.464115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:18.471558 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d8dca983-48b0-42e2-9aca-a963bb983d02 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1210 microversion: 2.1 time: 0.083047 Aug 02 10:29:18.472116 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 585/1164] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:18 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:19.492687 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:19.493311 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:19.509193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.509906 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.510778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:19.511228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:19.741727 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:19.750462 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a746e1f6-229d-4b68-8ca1-a8996f763241 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1276 microversion: 2.1 time: 0.261930 Aug 02 10:29:19.751232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 580/1165] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:19 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:20.080643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-ff203449-d6fd-43be-82d4-8808d2262553 req-7b7e5c35-f6c8-49e1-93df-6b900a43f07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154e3419-4475-496e-838c-9d18515b4e22", "tag": "374e4c4f-9cc8-4ba1-945b-1b28b25c4207"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:20.090980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ff203449-d6fd-43be-82d4-8808d2262553 req-7b7e5c35-f6c8-49e1-93df-6b900a43f07a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.091507 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-ff203449-d6fd-43be-82d4-8808d2262553 req-7b7e5c35-f6c8-49e1-93df-6b900a43f07a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.103859 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-ff203449-d6fd-43be-82d4-8808d2262553 req-7b7e5c35-f6c8-49e1-93df-6b900a43f07a service nova] Creating event network-changed:374e4c4f-9cc8-4ba1-945b-1b28b25c4207 for instance 154e3419-4475-496e-838c-9d18515b4e22 on hv-cinder-84713 Aug 02 10:29:20.108949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-ff203449-d6fd-43be-82d4-8808d2262553 req-7b7e5c35-f6c8-49e1-93df-6b900a43f07a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 Aug 02 10:29:20.109639 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 586/1166] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:20.772069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:20.772688 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:20.779125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.779578 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.780347 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:20.780787 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:20.923485 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:20.931120 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2133e317-70e5-432b-9539-4107b1457020 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.162927 Aug 02 10:29:20.931693 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 581/1167] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:20 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:21.952852 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:21.953598 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:21.960801 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.961258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:21.962052 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:21.962497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:22.102243 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:22.110205 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cb4d75df-e75d-47ca-b67c-b6ee0d0e7fa6 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.161188 Aug 02 10:29:22.110779 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 587/1168] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:21 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:23.131455 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:23.131998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:23.138396 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.138840 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.139586 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:23.140012 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:23.268217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:23.275615 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4890dd7e-0658-4457-8be5-174f4d9ee98c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.148052 Aug 02 10:29:23.276188 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 582/1169] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:23 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:24.296459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:24.297141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:24.299602 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:24.305370 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.305854 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.306636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:24.307077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:24.442442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:24.449745 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-98d9f161-3f8d-4c81-884b-faa2fc98e55e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.157140 Aug 02 10:29:24.450317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 588/1170] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:24 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:25.471031 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:25.471585 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:25.473555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:25.474270 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:25.480555 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.481007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.481776 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:25.482238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:25.613250 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:25.620744 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1701dc64-a537-4c5b-be77-541ed8ee58f5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.154417 Aug 02 10:29:25.621315 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 583/1171] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:25 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:26.641132 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:26.641809 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:26.648273 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.648725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.649494 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:26.649973 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:26.784015 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:26.791461 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f7cf43cb-d797-4d2a-9721-7026f04ef68c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.154199 Aug 02 10:29:26.792025 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 589/1172] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:26 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:27.812567 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:27.814488 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:27.821664 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.822263 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.823030 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:27.823461 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:27.956051 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:27.963458 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2ef5bc2f-e6b6-4058-a4c2-2741ee2db67e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.154851 Aug 02 10:29:27.964021 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 584/1173] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:27 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:28.983923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:28.984544 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:28.991100 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.991556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:28.992322 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:28.992761 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:29.120646 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:29.128822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1a104db2-d472-4700-a5c2-31bd492c0fb5 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.148946 Aug 02 10:29:29.129384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 590/1174] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:28 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:30.149254 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:30.149898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:30.162332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.162332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.162332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:30.162332 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:30.292115 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:30.299980 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-9e61e786-1c92-4a51-b07d-0004eb1ce5fa tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.154634 Aug 02 10:29:30.300545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 585/1175] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:30 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:31.320702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:31.321317 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:31.327898 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.328349 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.329760 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:31.330217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:31.463549 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:31.471193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ab1d1db3-54ed-4853-b5b6-1d6eff8064b8 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.154265 Aug 02 10:29:31.471765 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 591/1176] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:31 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:32.492471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:32.493096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:32.499630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.500085 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.500854 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:32.501289 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:32.641859 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:32.649588 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a6dc2d6b-128e-4f84-8c84-090a0493af5c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.160997 Aug 02 10:29:32.650192 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 586/1177] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:32 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:33.669992 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:33.670634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:33.677771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.678258 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.679090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:33.679537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:33.812866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:33.820782 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6044f4a6-007d-4771-afe7-aadcfb77f1ae tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.154914 Aug 02 10:29:33.821343 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 592/1178] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:33 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:34.499663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:34.500152 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:34.507179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.507619 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.508371 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.508799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.587814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lazy-loading 'services' on Instance uuid 0e8b37cd-9881-4f92-b287-792d03666d63 {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:29:34.656760 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ebc89105-c1d0-4b69-bbf3-af47ce9e4b25 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63/os-volume_attachments/7d7184af-818f-4137-a4b3-81434aadf96a" status: 202 len: 0 microversion: 2.1 time: 0.160858 Aug 02 10:29:34.657352 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 587/1179] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:29:34 2022] DELETE /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63/os-volume_attachments/7d7184af-818f-4137-a4b3-81434aadf96a => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:29:34.842503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:34.843120 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:34.850305 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.850758 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.851539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:34.851976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:34.982112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:34.990229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e26e0379-be5b-432f-81de-0fa2f62c6303 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.151682 Aug 02 10:29:34.990799 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 593/1180] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:34 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:35.163563 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-49f0314b-91fc-4bfd-b28e-e34e888e7052 req-a5ec70e8-a6a8-48f3-bd21-0969474e0ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154e3419-4475-496e-838c-9d18515b4e22", "name": "network-vif-plugged", "status": "completed", "tag": "374e4c4f-9cc8-4ba1-945b-1b28b25c4207"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:35.174242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-49f0314b-91fc-4bfd-b28e-e34e888e7052 req-a5ec70e8-a6a8-48f3-bd21-0969474e0ab6 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:35.174749 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-49f0314b-91fc-4bfd-b28e-e34e888e7052 req-a5ec70e8-a6a8-48f3-bd21-0969474e0ab6 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:35.187135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-49f0314b-91fc-4bfd-b28e-e34e888e7052 req-a5ec70e8-a6a8-48f3-bd21-0969474e0ab6 service nova] Creating event network-vif-plugged:374e4c4f-9cc8-4ba1-945b-1b28b25c4207 for instance 154e3419-4475-496e-838c-9d18515b4e22 on hv-cinder-84713 Aug 02 10:29:35.192103 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-49f0314b-91fc-4bfd-b28e-e34e888e7052 req-a5ec70e8-a6a8-48f3-bd21-0969474e0ab6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Aug 02 10:29:35.192872 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 588/1181] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:36.010465 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.011081 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.017618 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.018150 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.018866 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.019304 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.152743 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:36.160249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8c426b87-7abc-4d29-9c8a-4357c53c73af tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.153716 Aug 02 10:29:36.160807 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 594/1182] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:36 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:36.845448 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.846062 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.852971 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.853426 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.854234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.854672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.879245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:29:36.952474 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-97182b18-978e-4bf9-8c33-c5250e064924 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 204 len: 0 microversion: 2.1 time: 0.111415 Aug 02 10:29:36.953078 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 589/1183] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:29:36 2022] DELETE /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:29:36.962193 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:36.962941 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:36.970189 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.970632 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:36.971398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:36.971830 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.102013 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:37.109422 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-84023a57-4b17-4e9a-a755-c8e0de19e9c9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1514 microversion: 2.1 time: 0.151325 Aug 02 10:29:37.110077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 595/1184] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:36 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:29:37.181484 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:37.182209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:37.188722 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.189181 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.190234 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:37.190674 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:37.325778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:37.334377 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bfcf058b-b132-4587-b337-5c3465043e23 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.156986 Aug 02 10:29:37.334955 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 590/1185] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:37 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:38.131261 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:38.131835 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:38.138274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.138730 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.139501 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.139940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.275778 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:38.283166 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-c1b720d3-d978-4b95-9a7d-355a0fa68a44 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1514 microversion: 2.1 time: 0.155875 Aug 02 10:29:38.283724 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 596/1186] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:38 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:38.354913 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:38.355553 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:38.362616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.363102 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.363873 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:38.364318 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:38.495276 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:38.503775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-01eafe78-be9f-46d6-99c2-b02969c890a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1264 microversion: 2.1 time: 0.152668 Aug 02 10:29:38.504351 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 591/1187] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:38 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:39.304485 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:39.305096 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:39.311529 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.311976 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.312729 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.313751 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.442325 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:39.449739 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ace6206e-552e-4fe0-9479-e100f3ce78d8 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1514 microversion: 2.1 time: 0.149206 Aug 02 10:29:39.450319 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 597/1188] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:39 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:39.524303 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:39.524922 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:39.531482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.532499 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.533271 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.533715 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.552966 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:39.741243 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:39.748768 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cf9c55a9-cf43-446c-b4de-0a217f7ec75a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1451 microversion: 2.1 time: 0.228375 Aug 02 10:29:39.749346 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 592/1189] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:39 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1451 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:39.769094 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:39.769810 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:39.776469 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.777000 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.777961 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:39.778475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:39.988530 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:39.995919 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-5f673f2e-9daf-468c-8423-3e5b687819a0 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1451 microversion: 2.1 time: 0.231278 Aug 02 10:29:39.996484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 598/1190] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:39 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:40.160025 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-66d37a70-c4f0-464c-9fd9-1062ffa16b6f req-654edd4e-dc3a-4d4e-92d8-594fcd7508ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8b37cd-9881-4f92-b287-792d03666d63", "name": "network-vif-deleted", "tag": "cfabd496-bdc0-4edf-a51b-7734701c16f8"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:40.171514 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-66d37a70-c4f0-464c-9fd9-1062ffa16b6f req-654edd4e-dc3a-4d4e-92d8-594fcd7508ee service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.171969 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-66d37a70-c4f0-464c-9fd9-1062ffa16b6f req-654edd4e-dc3a-4d4e-92d8-594fcd7508ee service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.187811 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-66d37a70-c4f0-464c-9fd9-1062ffa16b6f req-654edd4e-dc3a-4d4e-92d8-594fcd7508ee service nova] Creating event network-vif-deleted:cfabd496-bdc0-4edf-a51b-7734701c16f8 for instance 0e8b37cd-9881-4f92-b287-792d03666d63 on hv-cinder-84713 Aug 02 10:29:40.193341 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-66d37a70-c4f0-464c-9fd9-1062ffa16b6f req-654edd4e-dc3a-4d4e-92d8-594fcd7508ee service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037582 Aug 02 10:29:40.194286 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 593/1191] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:40.471270 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:40.471946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:40.478389 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.478838 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.479607 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.480048 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.512612 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:40.513064 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:40.513515 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.objects.instance [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lazy-loading 'fault' on Instance uuid 0e8b37cd-9881-4f92-b287-792d03666d63 {{(pid=118031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:29:40.557850 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:40.566255 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0a09ffe0-d93f-4625-b0ef-10f437d6679f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 200 len: 1309 microversion: 2.1 time: 0.099800 Aug 02 10:29:40.567035 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 599/1192] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:40 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:41.589571 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:41.590245 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: 0e8b37cd-9881-4f92-b287-792d03666d63] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:41.597382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.597855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.598642 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:41.599088 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:41.617501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] HTTP exception thrown: Instance 0e8b37cd-9881-4f92-b287-792d03666d63 could not be found. Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Request method failure captured: Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 HTTP/1.1 Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PxE5-SI5D8O0BWV3VJzvU047NeMdSowPu_4fkYZK6bVukYfrvUROJZGhmLDrR-IcZsaek4s3_PiJD8bI9CrN43dAVe-RAwQJ8vRR9h_Dn_RVp1fsJeLNxlC9xpf5LfSxYXk4_Y6aOHdG9LXD1f1QG4lC6q05VYIf02qDz2nzCiiwMU Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: f99abdc12f9d404498711c2eb6c3363c Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506160341 Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:29:41.619231 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f99abdc12f9d404498711c2eb6c3363c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f99abdc12f9d404498711c2eb6c3363c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f99abdc12f9d404498711c2eb6c3363c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f99abdc12f9d404498711c2eb6c3363c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesSnapshotTestJSON-506160341 Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: f99abdc12f9d404498711c2eb6c3363c Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506160341 Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesSnapshotTestJSON-506160341-project Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 28db30abecd2452e89be5b3b89cc39e7 Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesSnapshotTestJSON-506160341-project Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 0e8b37cd-9881-4f92-b287-792d03666d63 could not be found. Aug 02 10:29:41.620948 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '0e8b37cd-9881-4f92-b287-792d03666d63'} Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8b37cd-9881-4f92-b287-792d03666d63 could not be found. Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:29:41.621934 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8b37cd-9881-4f92-b287-792d03666d63 could not be found. Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8b37cd-9881-4f92-b287-792d03666d63 could not be found. Aug 02 10:29:41.623636 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:29:41.624871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Returning 404 to user: Instance 0e8b37cd-9881-4f92-b287-792d03666d63 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:29:41.624871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2339af79-75b6-4922-ae43-f4b7ded0a102 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63" status: 404 len: 111 microversion: 2.1 time: 0.035988 Aug 02 10:29:41.624871 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 594/1193] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:41 2022] GET /compute/v2.1/servers/0e8b37cd-9881-4f92-b287-792d03666d63 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:29:42.210780 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-12d808ac-f90e-4310-91d5-47ef3dbb3f29 req-a8236920-9918-4831-a4f8-fc24e3c6696b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154e3419-4475-496e-838c-9d18515b4e22", "tag": "374e4c4f-9cc8-4ba1-945b-1b28b25c4207"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:42.220792 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-12d808ac-f90e-4310-91d5-47ef3dbb3f29 req-a8236920-9918-4831-a4f8-fc24e3c6696b service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:42.221245 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-12d808ac-f90e-4310-91d5-47ef3dbb3f29 req-a8236920-9918-4831-a4f8-fc24e3c6696b service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:42.232497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-12d808ac-f90e-4310-91d5-47ef3dbb3f29 req-a8236920-9918-4831-a4f8-fc24e3c6696b service nova] Creating event network-changed:374e4c4f-9cc8-4ba1-945b-1b28b25c4207 for instance 154e3419-4475-496e-838c-9d18515b4e22 on hv-cinder-84713 Aug 02 10:29:42.238348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-12d808ac-f90e-4310-91d5-47ef3dbb3f29 req-a8236920-9918-4831-a4f8-fc24e3c6696b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031112 Aug 02 10:29:42.239221 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 600/1194] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:53.538949 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1421797072", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "networks": [{"uuid": "5ff1c676-c46e-4ef1-8acf-896106b315a7"}]}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:53.547319 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:53.547987 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:53.595779 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] validate_networks() for [('5ff1c676-c46e-4ef1-8acf-896106b315a7', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:29:53.941042 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:29:53.941471 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:29:53.942050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:29:53.942463 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:29:53.942879 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:29:53.951694 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:53.952140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:53.952938 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:53.953375 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:53.970134 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Getting quotas for project f99abdc12f9d404498711c2eb6c3363c. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:29:53.974078 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Getting quotas for user 28db30abecd2452e89be5b3b89cc39e7 and project f99abdc12f9d404498711c2eb6c3363c. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:29:53.984818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:29:53.987616 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:29:54.032989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-66b21b27-aa34-4f4a-825e-9227e4420a91 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497839 Aug 02 10:29:54.033623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 595/1195] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:29:54.044771 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-eb898129-3398-4615-a8e8-0a1363cd4897 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:54.045472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-eb898129-3398-4615-a8e8-0a1363cd4897 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:54.048670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=40 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:54.049411 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=96 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:29:54.103078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-eb898129-3398-4615-a8e8-0a1363cd4897 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:54.111117 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-eb898129-3398-4615-a8e8-0a1363cd4897 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1219 microversion: 2.1 time: 0.070002 Aug 02 10:29:54.111674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 601/1196] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:54 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:55.132219 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:55.132774 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:55.138849 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.139299 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.140063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:55.140501 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:55.206460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:55.213920 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-a8024762-cce6-47bf-bcc5-cdc5a7e76ca9 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1271 microversion: 2.1 time: 0.086123 Aug 02 10:29:55.214481 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 596/1197] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:55 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:56.236085 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:56.236724 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:56.243316 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.243775 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.244553 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.245024 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.486430 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:56.493819 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-0b461cd8-90cc-4f9a-8a1e-bf34f6ba5513 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.262235 Aug 02 10:29:56.494384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 602/1198] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:56 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:56.630313 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-40494f43-ce16-45d6-9d2e-93956f0a3f32 req-265e687e-7398-432e-b575-5df0aa16069a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92b1fac-9195-44d6-b961-e0b42b8ac0ac", "tag": "48443f5f-d494-4579-9bb0-719c9242790c"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:29:56.640356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-40494f43-ce16-45d6-9d2e-93956f0a3f32 req-265e687e-7398-432e-b575-5df0aa16069a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:56.640895 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-40494f43-ce16-45d6-9d2e-93956f0a3f32 req-265e687e-7398-432e-b575-5df0aa16069a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:56.654878 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-40494f43-ce16-45d6-9d2e-93956f0a3f32 req-265e687e-7398-432e-b575-5df0aa16069a service nova] Creating event network-changed:48443f5f-d494-4579-9bb0-719c9242790c for instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac on hv-cinder-84713 Aug 02 10:29:56.660355 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-40494f43-ce16-45d6-9d2e-93956f0a3f32 req-265e687e-7398-432e-b575-5df0aa16069a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034731 Aug 02 10:29:56.661275 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 597/1199] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:29:57.514718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:57.515340 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:57.522318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.522770 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.523539 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:57.523981 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:57.649592 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:57.656949 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8e45d3c8-8e95-41ab-8824-8caaee1184d1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.146094 Aug 02 10:29:57.657512 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 603/1200] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:57 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:58.678066 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:58.678787 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:58.685404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.685887 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.686712 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:58.687142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:58.817499 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:29:58.824955 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-8c921fb3-2119-4b96-8237-98993eabf87e tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.151115 Aug 02 10:29:58.825704 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 598/1201] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:58 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:29:59.846462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:29:59.847090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:29:59.853863 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.854323 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:29:59.855112 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:29:59.855552 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:00.089766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:00.097490 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-cb2bb611-a820-4a6d-aef4-4dd05853b9e0 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.254893 Aug 02 10:30:00.098309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 604/1202] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:29:59 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:01.118988 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:01.119659 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:01.126659 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.127125 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.127892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:01.128339 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:01.261083 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:01.269147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b65617b2-0317-40da-8354-f46205798a6f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.154035 Aug 02 10:30:01.269602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 599/1203] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:01 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:30:02.167210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-3b4b3401-37cf-4aae-81fe-f094a320be37 req-1da5fde3-dcff-4edd-b399-bbdb18947380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92b1fac-9195-44d6-b961-e0b42b8ac0ac", "name": "network-vif-plugged", "status": "completed", "tag": "48443f5f-d494-4579-9bb0-719c9242790c"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:30:02.177507 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3b4b3401-37cf-4aae-81fe-f094a320be37 req-1da5fde3-dcff-4edd-b399-bbdb18947380 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.177985 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3b4b3401-37cf-4aae-81fe-f094a320be37 req-1da5fde3-dcff-4edd-b399-bbdb18947380 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.188952 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-3b4b3401-37cf-4aae-81fe-f094a320be37 req-1da5fde3-dcff-4edd-b399-bbdb18947380 service nova] Creating event network-vif-plugged:48443f5f-d494-4579-9bb0-719c9242790c for instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac on hv-cinder-84713 Aug 02 10:30:02.194090 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-3b4b3401-37cf-4aae-81fe-f094a320be37 req-1da5fde3-dcff-4edd-b399-bbdb18947380 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030687 Aug 02 10:30:02.194674 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 605/1204] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:02.289898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:02.290550 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:02.297148 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.297628 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.298438 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:02.298880 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:02.499075 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:02.506548 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c44da615-6edb-4d17-a5f3-934dd26a2456 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.220633 Aug 02 10:30:02.507124 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 600/1205] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:02 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:03.528613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:03.529312 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:03.535914 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.536372 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.537183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:03.537613 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:03.664545 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:03.671946 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-66b46ca9-798a-4c11-9a2e-857810fe2f32 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1319 microversion: 2.1 time: 0.148192 Aug 02 10:30:03.672509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 606/1206] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:03 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:04.693343 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:04.694090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:04.696890 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:04.697865 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:04.703947 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.704908 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.705676 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.706141 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.840108 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:04.847652 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-aa75ae04-57c2-4931-a9e2-80eec0389d30 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1509 microversion: 2.1 time: 0.158460 Aug 02 10:30:04.848222 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 601/1207] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:04 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:04.867970 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e25dd05f-efb3-445b-a4d5-0359f5469cc8", "device": "/dev/sdb"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:30:04.870380 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:04.872355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=2 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:04.878954 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.879410 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:04.880179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:04.880620 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:05.125199 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-76295848-1efa-44cc-9f0f-f5a4286ea239 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "POST /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261004 Aug 02 10:30:05.125849 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 607/1208] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:30:04 2022] POST /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:28.582385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:28.582908 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:28.585529 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:28.586288 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=34 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:28.592683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.593122 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.593900 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:28.594327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:28.675496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lazy-loading 'services' on Instance uuid d92b1fac-9195-44d6-b961-e0b42b8ac0ac {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:30:28.752242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-52d6951d-fa9d-4f7f-b3f6-5173765f344b tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac/os-volume_attachments/e25dd05f-efb3-445b-a4d5-0359f5469cc8" status: 202 len: 0 microversion: 2.1 time: 0.173654 Aug 02 10:30:28.752836 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 602/1209] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:30:28 2022] DELETE /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac/os-volume_attachments/e25dd05f-efb3-445b-a4d5-0359f5469cc8 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:30:29.876973 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=16 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:29.878001 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:30:29.883385 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:29.883980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:29.891488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.891940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.892710 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:29.893151 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:29.918531 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:30:29.992889 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-3a2383d4-93d0-4e62-9be2-b1e2dae78bb1 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 204 len: 0 microversion: 2.1 time: 0.117279 Aug 02 10:30:29.993482 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 608/1210] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:30:29 2022] DELETE /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:30:30.003242 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:30.003947 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:30.010868 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.011238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.011997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:30.012434 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:30.144672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:30.152778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-33dee080-0a4e-4891-8a68-6bdb6f867d09 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1515 microversion: 2.1 time: 0.154416 Aug 02 10:30:30.153338 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 603/1211] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:29 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:31.174383 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:31.175088 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:31.181659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.182147 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.182916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:31.183355 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:31.311700 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:31.319945 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-745ecb0b-9f4d-4628-8dad-42a857342c12 tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1515 microversion: 2.1 time: 0.149898 Aug 02 10:30:31.320502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 609/1212] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:31 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:32.340952 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:32.341564 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:32.348230 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.349211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.349990 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.350420 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.553772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28db30abecd2452e89be5b3b89cc39e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99abdc12f9d404498711c2eb6c3363c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:30:32.567336 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6997c6d9-8e8b-4dab-96ec-23d135e04e9d tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 200 len: 1515 microversion: 2.1 time: 0.230204 Aug 02 10:30:32.568011 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 604/1213] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:32 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:30:32.954505 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-7681fc8b-1dad-4b32-adfc-5c26cbfac95b req-db52c673-823d-49ea-947c-f05fadcd7f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92b1fac-9195-44d6-b961-e0b42b8ac0ac", "name": "network-vif-deleted", "tag": "48443f5f-d494-4579-9bb0-719c9242790c"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:30:32.970691 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-7681fc8b-1dad-4b32-adfc-5c26cbfac95b req-db52c673-823d-49ea-947c-f05fadcd7f9a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:32.971139 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-7681fc8b-1dad-4b32-adfc-5c26cbfac95b req-db52c673-823d-49ea-947c-f05fadcd7f9a service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:32.982915 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-7681fc8b-1dad-4b32-adfc-5c26cbfac95b req-db52c673-823d-49ea-947c-f05fadcd7f9a service nova] Creating event network-vif-deleted:48443f5f-d494-4579-9bb0-719c9242790c for instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac on hv-cinder-84713 Aug 02 10:30:32.987846 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-7681fc8b-1dad-4b32-adfc-5c26cbfac95b req-db52c673-823d-49ea-947c-f05fadcd7f9a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036956 Aug 02 10:30:32.988472 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 610/1214] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:30:33.588600 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:30:33.589217 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] [instance: d92b1fac-9195-44d6-b961-e0b42b8ac0ac] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:30:33.595742 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.596194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.596960 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:30:33.597397 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:30:33.612993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] HTTP exception thrown: Instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac could not be found. Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Request method failure captured: Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac HTTP/1.1 Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PxE5-SI5D8O0BWV3VJzvU047NeMdSowPu_4fkYZK6bVukYfrvUROJZGhmLDrR-IcZsaek4s3_PiJD8bI9CrN43dAVe-RAwQJ8vRR9h_Dn_RVp1fsJeLNxlC9xpf5LfSxYXk4_Y6aOHdG9LXD1f1QG4lC6q05VYIf02qDz2nzCiiwMU Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: f99abdc12f9d404498711c2eb6c3363c Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506160341 Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:30:33.614653 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f99abdc12f9d404498711c2eb6c3363c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f99abdc12f9d404498711c2eb6c3363c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f99abdc12f9d404498711c2eb6c3363c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f99abdc12f9d404498711c2eb6c3363c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-VolumesSnapshotTestJSON-506160341 Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: f99abdc12f9d404498711c2eb6c3363c Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506160341 Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-VolumesSnapshotTestJSON-506160341-project Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 28db30abecd2452e89be5b3b89cc39e7 Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-VolumesSnapshotTestJSON-506160341-project Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac could not be found. Aug 02 10:30:33.616416 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'd92b1fac-9195-44d6-b961-e0b42b8ac0ac'} Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac could not be found. Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:30:33.617451 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac could not be found. Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac could not be found. Aug 02 10:30:33.619087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:30:33.620496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] Returning 404 to user: Instance d92b1fac-9195-44d6-b961-e0b42b8ac0ac could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:30:33.620496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-c773f3f6-0f12-4ba1-be92-75bd7da7201f tempest-VolumesSnapshotTestJSON-506160341 tempest-VolumesSnapshotTestJSON-506160341-project] 10.222.0.82 "GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac" status: 404 len: 111 microversion: 2.1 time: 0.031357 Aug 02 10:30:33.620496 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 605/1215] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:30:33 2022] GET /compute/v2.1/servers/d92b1fac-9195-44d6-b961-e0b42b8ac0ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:31:02.382188 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:02.383026 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:02.611982 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:02.612566 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:02.618731 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.619177 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.619967 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:02.620414 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:02.642643 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-8cd5f764-6106-4e42-882f-0550e04a3c63 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/ips" status: 200 len: 148 microversion: 2.1 time: 0.262108 Aug 02 10:31:02.643183 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 611/1216] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:31:02 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/ips => generated 148 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:03.975829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2867c02c-e74a-4fad-a420-bcf02b36a029"}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:03.978363 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:03.980509 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=8 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:03.981153 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:03.986770 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.987232 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:03.988000 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:03.988439 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:04.342092 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f63a15c0-18a6-487b-a431-1ca6aebfb95c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370771 Aug 02 10:31:04.342723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 606/1217] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:31:03 2022] POST /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:11.854484 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2867c02c-e74a-4fad-a420-bcf02b36a029"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:11.856987 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:11.863588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.864097 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.864861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:11.865295 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:11.995398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Invalid volume: volume 2867c02c-e74a-4fad-a420-bcf02b36a029 is already attached to instances: e64d6553-8f47-403a-a644-70887989602b Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: POST /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments HTTP/1.1 Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 74 Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:31:11.997149 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {"volumeAttachment": {"volumeId": "2867c02c-e74a-4fad-a420-bcf02b36a029"}} Aug 02 10:31:11.998923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Invalid volume: volume 2867c02c-e74a-4fad-a420-bcf02b36a029 is already attached to instances: e64d6553-8f47-403a-a644-70887989602b Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'server_id': 'e64d6553-8f47-403a-a644-70887989602b', 'body': {'volumeAttachment': {'volumeId': '2867c02c-e74a-4fad-a420-bcf02b36a029'}}} Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2867c02c-e74a-4fad-a420-bcf02b36a029 is already attached to instances: e64d6553-8f47-403a-a644-70887989602b Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:12.000523 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2867c02c-e74a-4fad-a420-bcf02b36a029 is already attached to instances: e64d6553-8f47-403a-a644-70887989602b Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:31:12.001891 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2867c02c-e74a-4fad-a420-bcf02b36a029 is already attached to instances: e64d6553-8f47-403a-a644-70887989602b Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 400 to user: Invalid volume: volume 2867c02c-e74a-4fad-a420-bcf02b36a029 is already attached to instances: e64d6553-8f47-403a-a644-70887989602b {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-590565e6-98fb-43ba-aaae-8e2d94c41a7c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148172 Aug 02 10:31:12.003290 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 612/1218] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:31:11 2022] POST /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:31:12.067464 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:12.068105 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:12.074531 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.074998 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.075794 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.076220 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.154211 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lazy-loading 'services' on Instance uuid e64d6553-8f47-403a-a644-70887989602b {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:31:12.228324 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-fe3c07ff-e266-4f54-b55d-2cf276542ca6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments/2867c02c-e74a-4fad-a420-bcf02b36a029" status: 202 len: 0 microversion: 2.1 time: 0.165654 Aug 02 10:31:12.228928 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 607/1219] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:31:12 2022] DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments/2867c02c-e74a-4fad-a420-bcf02b36a029 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:31:12.237308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:12.239537 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:12.245808 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.246314 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.247110 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:12.247667 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:12.278179 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-46898d83-d99d-4b3c-9808-b055f9807e42 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Aug 02 10:31:12.278660 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 613/1220] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:12 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:13.291855 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:13.294170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:13.300385 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.300835 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.302261 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.302700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.331096 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4c51aba6-c276-4f0a-84ac-589ea3c2f55b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044154 Aug 02 10:31:13.331646 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 608/1221] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:31:13 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:31:13.391918 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:13.392413 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:13.399400 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.399944 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.400725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.401164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.425851 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:31:13.500763 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-215b7d2b-e80e-4274-85b5-29b28fcc4099 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 204 len: 0 microversion: 2.1 time: 0.112310 Aug 02 10:31:13.501580 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 614/1222] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:31:13 2022] DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:31:13.510031 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:13.510929 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:13.518807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.519269 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.520050 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:13.520515 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:13.580260 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:31:13.580506 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:31:13.650511 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:13.658088 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-15738ab1-a01f-43e0-8fef-de475fe7decd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1679 microversion: 2.1 time: 0.152066 Aug 02 10:31:13.658683 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 609/1223] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:13 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:14.680737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:14.681442 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:14.687900 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.688348 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.689111 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:14.689822 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:14.820743 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:14.828363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-12b50474-e3e4-45c2-99e4-83f5d42a2e0f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1679 microversion: 2.1 time: 0.151884 Aug 02 10:31:14.828929 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 615/1224] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:14 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:15.850349 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:15.851097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:15.857557 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.858038 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:15.858800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:15.859238 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:16.095978 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:16.104145 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-242a61df-eb73-4bef-84ae-ffab7d3724dd tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1679 microversion: 2.1 time: 0.258196 Aug 02 10:31:16.104649 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 610/1225] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:15 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:16.741338 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-3e00b517-269a-4c17-b66b-698ddcaa33be req-599f08d0-9baf-4a81-9caf-6e17bb4eec24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64d6553-8f47-403a-a644-70887989602b", "name": "network-vif-deleted", "tag": "49319e0d-43b5-4132-83ac-34d3f899f8cd"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:16.751874 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3e00b517-269a-4c17-b66b-698ddcaa33be req-599f08d0-9baf-4a81-9caf-6e17bb4eec24 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:16.752311 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-3e00b517-269a-4c17-b66b-698ddcaa33be req-599f08d0-9baf-4a81-9caf-6e17bb4eec24 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:16.763770 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-3e00b517-269a-4c17-b66b-698ddcaa33be req-599f08d0-9baf-4a81-9caf-6e17bb4eec24 service nova] Creating event network-vif-deleted:49319e0d-43b5-4132-83ac-34d3f899f8cd for instance e64d6553-8f47-403a-a644-70887989602b on hv-cinder-84713 Aug 02 10:31:16.769510 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-3e00b517-269a-4c17-b66b-698ddcaa33be req-599f08d0-9baf-4a81-9caf-6e17bb4eec24 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031925 Aug 02 10:31:16.770983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 616/1226] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:17.124800 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:17.125500 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:17.132986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.133807 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.134684 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.135126 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.169246 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:17.169701 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:17.170196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lazy-loading 'fault' on Instance uuid e64d6553-8f47-403a-a644-70887989602b {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:31:17.213834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:17.226344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-3ba2d608-c294-462f-9b0c-02d40433126e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 200 len: 1331 microversion: 2.1 time: 0.105124 Aug 02 10:31:17.232272 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 611/1227] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:17 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:18.248435 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:18.249141 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:18.256011 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.256462 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.257231 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:18.257670 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:18.271123 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b HTTP/1.1 Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:31:18.272688 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:31:18.274483 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'e64d6553-8f47-403a-a644-70887989602b'} Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:31:18.275488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:31:18.277115 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:31:18.278684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:31:18.278684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-53f90942-c002-4096-aeb8-65fc1783f8df tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 404 len: 111 microversion: 2.1 time: 0.030279 Aug 02 10:31:18.278684 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 617/1228] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:18 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:31:18.282915 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-39cea119-9ffd-46c1-80a5-52b133ee4041 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '.version_select at 0x7f5c0810f550>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:18.287454 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39cea119-9ffd-46c1-80a5-52b133ee4041 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [9419ed0b-1d23-42d5-8211-b518f2bdd762] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 10:31:19.294236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO oslo.messaging._drivers.impl_rabbit [None req-39cea119-9ffd-46c1-80a5-52b133ee4041 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [9419ed0b-1d23-42d5-8211-b518f2bdd762] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 55758. Aug 02 10:31:19.312750 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-39cea119-9ffd-46c1-80a5-52b133ee4041 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111570097" status: 202 len: 0 microversion: 2.1 time: 1.033630 Aug 02 10:31:19.313349 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 612/1229] 10.222.0.82 () {58 vars in 1221 bytes} [Tue Aug 2 10:31:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111570097 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:31:19.924390 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-fecac17f-12aa-4f49-a837-a63fe884344b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: .version_select at 0x7f5c080fd430>, body: {"keypair": {"name": "tempest-keypair-1608081653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPnnADZCNkqFSam7q1aF6JLdNl2EoWM1pKfQnaj9S8DGChM81kmwoGZ2PNgsemYSpNYaRdGV5qZbA3gdJBZkjgopRqM4Z+FVOEDElXNyDCZB2AW2C5qrZy+mP2qiWLAiA=="}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:19.940381 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-fecac17f-12aa-4f49-a837-a63fe884344b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:31:19.944541 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.quota [None req-fecac17f-12aa-4f49-a837-a63fe884344b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'key_pairs'} {{(pid=118031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:31:19.968328 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-fecac17f-12aa-4f49-a837-a63fe884344b tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047860 Aug 02 10:31:19.968916 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 618/1230] 10.222.0.82 () {60 vars in 1159 bytes} [Tue Aug 2 10:31:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:21.170147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2030188833", "imageRef": "19ab24e4-ff03-4117-be94-ec33c76344ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c06faac-b7f7-48ef-b76d-6bd0b909a62b"}], "security_groups": [{"name": "tempest-securitygroup--1151028505"}], "key_name": "tempest-keypair-1608081653", "user_data": "}} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:21.274619 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.network.neutron [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] validate_networks() for [('7c06faac-b7f7-48ef-b76d-6bd0b909a62b', None, None, None, None, None)] {{(pid=118032) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:31:21.653602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:31:21.654054 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image limits 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:31:21.654525 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Flavor pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:31:21.654933 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Image pref 0:0:0 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:31:21.655354 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.virt.hardware [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:31:21.664643 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.665114 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.665950 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:21.666386 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:21.683870 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:31:21.687834 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.quota [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Getting quotas for user 8774306d95c0476b80cc8e53b62e8a4b and project 9389c81a2710466ea8be45d2fe2342ef. Resources: {'instances', 'cores', 'ram'} {{(pid=118032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:31:21.698894 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Going to run 1 instances... {{(pid=118032) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:31:21.701244 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19ab24e4-ff03-4117-be94-ec33c76344ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:31:21.746356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-04ddb021-15ee-4544-ae1b-9db749a16b5f tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580453 Aug 02 10:31:21.747164 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 613/1231] 10.222.0.82 () {60 vars in 1147 bytes} [Tue Aug 2 10:31:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 10:31:21.758294 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-74588fb1-3a4c-4b48-95ed-4d73ac20e0a3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:21.759027 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-74588fb1-3a4c-4b48-95ed-4d73ac20e0a3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:21.815995 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-74588fb1-3a4c-4b48-95ed-4d73ac20e0a3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:21.824318 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-74588fb1-3a4c-4b48-95ed-4d73ac20e0a3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1242 microversion: 2.1 time: 0.070441 Aug 02 10:31:21.825189 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 619/1232] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:21 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:22.846340 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:22.847079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:22.853276 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:22.853729 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:22.854531 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:22.854977 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:22.940890 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:22.949024 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6ab37cdc-8820-493d-991a-90376b0521dc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1300 microversion: 2.1 time: 0.107107 Aug 02 10:31:22.949602 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 614/1233] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:22 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:23.969922 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:23.970615 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:23.978133 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:23.978587 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:23.979356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:23.979790 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.169259 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:24.178215 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-ec122ea7-6464-4b57-b5c1-f80e83491966 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.212101 Aug 02 10:31:24.178864 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 620/1234] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:23 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:24.218294 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-dd155afa-7cb4-4a87-9364-5fbcc69cf727 req-ef3cc7b2-21e7-4490-a4a9-c076222ab3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8999e9d4-708d-45ee-9db1-9c6459c99e57", "tag": "9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:24.229365 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-dd155afa-7cb4-4a87-9364-5fbcc69cf727 req-ef3cc7b2-21e7-4490-a4a9-c076222ab3d7 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:24.229898 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-dd155afa-7cb4-4a87-9364-5fbcc69cf727 req-ef3cc7b2-21e7-4490-a4a9-c076222ab3d7 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:24.242641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-dd155afa-7cb4-4a87-9364-5fbcc69cf727 req-ef3cc7b2-21e7-4490-a4a9-c076222ab3d7 service nova] Creating event network-changed:9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78 for instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 on hv-cinder-84713 Aug 02 10:31:24.248756 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-dd155afa-7cb4-4a87-9364-5fbcc69cf727 req-ef3cc7b2-21e7-4490-a4a9-c076222ab3d7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035086 Aug 02 10:31:24.249819 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 615/1235] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:25.200016 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:25.200634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:25.207239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.207687 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.208460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:25.208888 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:25.350415 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:25.358184 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f42475f8-1cf3-4877-9eb1-c5b81a62dcb5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.162001 Aug 02 10:31:25.358695 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 621/1236] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:25 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:26.383356 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:26.384100 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:26.390792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.391255 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.391986 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:26.392413 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:26.522421 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:26.529816 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-59d60e7e-9bf1-44f2-99a9-bb68aec649d7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.150723 Aug 02 10:31:26.530395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 616/1237] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:26 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:27.550677 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:27.551292 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:27.557515 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.558014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.558812 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:27.559248 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:27.687025 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:27.695740 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6ba26613-320a-4b11-acaf-c6b5a49e56fc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.148859 Aug 02 10:31:27.696312 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 622/1238] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:27 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:28.717775 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:28.718415 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:28.725591 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:28.726136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:28.726911 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:28.727382 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:29.133424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:29.141056 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-59af80fc-42e7-4875-a76d-256f92811846 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.427199 Aug 02 10:31:29.141641 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 617/1239] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:28 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:29.845300 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:31:29.845936 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:31:30.168239 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:30.168853 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:30.175459 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.175909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.177419 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.178080 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.221104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-fb2dddf4-fbcb-4c26-9a0a-36d3d6388147 req-ed65af68-dabc-4294-b978-08430fbc9b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8999e9d4-708d-45ee-9db1-9c6459c99e57", "name": "network-vif-plugged", "status": "completed", "tag": "9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:30.232316 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-fb2dddf4-fbcb-4c26-9a0a-36d3d6388147 req-ed65af68-dabc-4294-b978-08430fbc9b43 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:30.232759 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-fb2dddf4-fbcb-4c26-9a0a-36d3d6388147 req-ed65af68-dabc-4294-b978-08430fbc9b43 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:30.245627 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-fb2dddf4-fbcb-4c26-9a0a-36d3d6388147 req-ed65af68-dabc-4294-b978-08430fbc9b43 service nova] Creating event network-vif-plugged:9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78 for instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 on hv-cinder-84713 Aug 02 10:31:30.250769 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-fb2dddf4-fbcb-4c26-9a0a-36d3d6388147 req-ed65af68-dabc-4294-b978-08430fbc9b43 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033334 Aug 02 10:31:30.251376 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 618/1240] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:31:30.320356 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:30.328737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-6c088d7b-7361-403f-8e7d-15be75ecc7e9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.164510 Aug 02 10:31:30.329309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 623/1241] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:30 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:31.351166 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:31.351863 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:31.358174 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.358625 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.359395 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:31.359821 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:31.497892 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:31.505314 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-5fb06e84-69c3-4066-a868-184a55b3bb0a tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.159389 Aug 02 10:31:31.505908 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 619/1242] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:31 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:32.526939 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:32.527584 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:32.529867 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell0:SELECT=6 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:32.530708 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:32.536964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.537418 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.538213 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:32.538652 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:32.543485 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:32.679547 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:32.687516 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-afe92ae8-3149-4a68-81cc-49782012c926 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1368 microversion: 2.1 time: 0.164371 Aug 02 10:31:32.688075 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 624/1243] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:32 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:33.709545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:33.710194 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:33.712161 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:33.712814 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell0:SELECT=6 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:33.719344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.719794 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.720560 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.720996 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.852651 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:31:33.860187 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-4ef95ced-4d70-4415-bf35-678153e5fae3 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1557 microversion: 2.1 time: 0.155197 Aug 02 10:31:33.860746 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 620/1244] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:31:33 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:31:33.880825 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:31:33.881346 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:31:33.887767 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.888212 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.888980 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:33.889416 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:33.965009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-99e8e991-66d5-413c-a6c5-448ae88ed81d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088534 Aug 02 10:31:33.965624 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 625/1245] 10.222.0.82 () {58 vars in 1275 bytes} [Tue Aug 2 10:31:33 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:31:34.878018 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-4d4bc8aa-2bdf-491c-9965-17d7dcf570c2 req-4ea9605a-4497-4539-825d-0744ee2c3783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8999e9d4-708d-45ee-9db1-9c6459c99e57", "tag": "9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:31:34.883797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:34.889460 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-4d4bc8aa-2bdf-491c-9965-17d7dcf570c2 req-4ea9605a-4497-4539-825d-0744ee2c3783 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:31:34.889925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-4d4bc8aa-2bdf-491c-9965-17d7dcf570c2 req-4ea9605a-4497-4539-825d-0744ee2c3783 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:31:34.894057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:31:34.902492 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-4d4bc8aa-2bdf-491c-9965-17d7dcf570c2 req-4ea9605a-4497-4539-825d-0744ee2c3783 service nova] Creating event network-changed:9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78 for instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 on hv-cinder-84713 Aug 02 10:31:34.907945 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-4d4bc8aa-2bdf-491c-9965-17d7dcf570c2 req-4ea9605a-4497-4539-825d-0744ee2c3783 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033759 Aug 02 10:31:34.908595 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 621/1246] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:00.859360 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=3 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:00.866073 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [req-2c97a3d7-4583-4bf3-bb55-8f0f4ec3b215 req-b4c32a87-1b8a-426f-a8d4-a95b03bc3c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154e3419-4475-496e-838c-9d18515b4e22", "tag": "374e4c4f-9cc8-4ba1-945b-1b28b25c4207"}]} {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:32:00.867532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=9 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:00.871554 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:00.872131 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:00.878473 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.879014 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.879903 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.880412 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.882758 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-2c97a3d7-4583-4bf3-bb55-8f0f4ec3b215 req-b4c32a87-1b8a-426f-a8d4-a95b03bc3c71 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:00.883209 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [req-2c97a3d7-4583-4bf3-bb55-8f0f4ec3b215 req-b4c32a87-1b8a-426f-a8d4-a95b03bc3c71 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:00.895976 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.compute.server_external_events [req-2c97a3d7-4583-4bf3-bb55-8f0f4ec3b215 req-b4c32a87-1b8a-426f-a8d4-a95b03bc3c71 service nova] Creating event network-changed:374e4c4f-9cc8-4ba1-945b-1b28b25c4207 for instance 154e3419-4475-496e-838c-9d18515b4e22 on hv-cinder-84713 Aug 02 10:32:00.902213 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [req-2c97a3d7-4583-4bf3-bb55-8f0f4ec3b215 req-b4c32a87-1b8a-426f-a8d4-a95b03bc3c71 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 Aug 02 10:32:00.903236 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 622/1247] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:00.908217 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:32:00.996923 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-db09d673-ea98-4c58-b30b-72fbcff19a5e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "DELETE /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 204 len: 0 microversion: 2.1 time: 0.139922 Aug 02 10:32:00.998055 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 626/1248] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:32:00 2022] DELETE /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:32:01.007022 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:01.007820 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:01.014829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:01.015284 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:01.016060 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:01.016498 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:01.154672 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:01.162327 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-da06bf9f-7801-4b3e-b464-85cb70a42ec9 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1575 microversion: 2.1 time: 0.159706 Aug 02 10:32:01.163027 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 623/1249] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:01 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:32:02.184801 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:02.185521 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:02.192308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:02.192762 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:02.193536 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:02.194018 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:02.412608 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:02.420226 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-465a7f90-4592-40e1-b073-87d47e52389a tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1575 microversion: 2.1 time: 0.239721 Aug 02 10:32:02.420791 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 627/1250] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:02 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:32:03.442869 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:03.443542 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:03.451127 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.451590 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.452364 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.452792 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.484302 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-840c9ea2-291b-44ad-85da-47d6d553a342 req-4b24d881-156f-46b7-bf6b-dc2639645007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154e3419-4475-496e-838c-9d18515b4e22", "name": "network-vif-deleted", "tag": "374e4c4f-9cc8-4ba1-945b-1b28b25c4207"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:32:03.494267 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-840c9ea2-291b-44ad-85da-47d6d553a342 req-4b24d881-156f-46b7-bf6b-dc2639645007 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:03.494798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-840c9ea2-291b-44ad-85da-47d6d553a342 req-4b24d881-156f-46b7-bf6b-dc2639645007 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:03.506498 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-840c9ea2-291b-44ad-85da-47d6d553a342 req-4b24d881-156f-46b7-bf6b-dc2639645007 service nova] Creating event network-vif-deleted:374e4c4f-9cc8-4ba1-945b-1b28b25c4207 for instance 154e3419-4475-496e-838c-9d18515b4e22 on hv-cinder-84713 Aug 02 10:32:03.512557 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-840c9ea2-291b-44ad-85da-47d6d553a342 req-4b24d881-156f-46b7-bf6b-dc2639645007 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 Aug 02 10:32:03.513164 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 628/1251] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:32:03.524456 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:03.532388 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-403900e2-3b02-43c9-b9c2-dcf12bced465 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 200 len: 1391 microversion: 2.1 time: 0.094185 Aug 02 10:32:03.532952 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 624/1252] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:03 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:32:04.553823 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:04.554555 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 154e3419-4475-496e-838c-9d18515b4e22] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:04.561401 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:04.561885 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:04.562680 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:04.563129 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:04.577099 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] HTTP exception thrown: Instance 154e3419-4475-496e-838c-9d18515b4e22 could not be found. Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Request method failure captured: Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 HTTP/1.1 Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6PsAdGMn_Omub4-Auu34OtG-j1a7ShrwnDm0PfhJ3EYZ-8UsspGOCuuVoMw5ggQGpoDRZqiKNsJSFRPyXGEnrk3D2dCPTQ8B3Bgf0kynMZ9YofDAA09_mAhhMkZAaMJclCdbQsXlh57zVLuOTTD0h9oCwqTX5SHORbjrcwmRMzk3tks Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:32:04.579010 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/06660bbc73344c53b5a0337808514df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_06660bbc73344c53b5a0337808514df7", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: e08bc25f122445f592652671790cc658 Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 154e3419-4475-496e-838c-9d18515b4e22 could not be found. Aug 02 10:32:04.580857 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '154e3419-4475-496e-838c-9d18515b4e22'} Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154e3419-4475-496e-838c-9d18515b4e22 could not be found. Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:32:04.581861 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154e3419-4475-496e-838c-9d18515b4e22 could not be found. Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154e3419-4475-496e-838c-9d18515b4e22 could not be found. Aug 02 10:32:04.583634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:04.585038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Returning 404 to user: Instance 154e3419-4475-496e-838c-9d18515b4e22 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:32:04.585038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-f9236bd2-4ece-4aae-873c-03649e4c5699 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22" status: 404 len: 111 microversion: 2.1 time: 0.031272 Aug 02 10:32:04.585038 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 629/1253] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:04 2022] GET /compute/v2.1/servers/154e3419-4475-496e-838c-9d18515b4e22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:32:07.913151 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:07.913691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:07.915475 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-22a24120-6595-4832-9f67-b6074bcea157 req-136b49d6-46bc-4a99-9df6-e8a67b048335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c5efe2-a517-4412-9f74-c78d30243786", "tag": "3d7c67d0-4abc-46a6-b841-3085b992a63a"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:32:07.920349 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.920798 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.921830 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.922135 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.925697 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-22a24120-6595-4832-9f67-b6074bcea157 req-136b49d6-46bc-4a99-9df6-e8a67b048335 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:07.926181 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-22a24120-6595-4832-9f67-b6074bcea157 req-136b49d6-46bc-4a99-9df6-e8a67b048335 service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:07.938384 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-22a24120-6595-4832-9f67-b6074bcea157 req-136b49d6-46bc-4a99-9df6-e8a67b048335 service nova] Creating event network-changed:3d7c67d0-4abc-46a6-b841-3085b992a63a for instance 28c5efe2-a517-4412-9f74-c78d30243786 on hv-cinder-84713 Aug 02 10:32:07.943630 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-22a24120-6595-4832-9f67-b6074bcea157 req-136b49d6-46bc-4a99-9df6-e8a67b048335 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032224 Aug 02 10:32:07.944437 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 630/1254] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:07.950735 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Going to try to terminate instance {{(pid=118032) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:32:08.033300 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e630e42c-7ec3-4dea-a966-c2cd19de9627 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "DELETE /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 204 len: 0 microversion: 2.1 time: 0.123801 Aug 02 10:32:08.041872 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 625/1255] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:32:07 2022] DELETE /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:32:08.043444 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:08.044264 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:08.051051 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:08.051503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:08.052283 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:08.052721 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:08.264062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:08.271768 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-503fe062-be60-469f-90ef-9d8feff4712e tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1577 microversion: 2.1 time: 0.233111 Aug 02 10:32:08.272398 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 631/1256] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:08 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:32:09.295104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:09.295809 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:09.302545 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:09.302979 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:09.303772 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:09.304203 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:09.409167 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08bc25f122445f592652671790cc658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06660bbc73344c53b5a0337808514df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:32:09.417180 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-e43baad1-97da-4598-b559-e73cd0e22b4b tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 200 len: 1392 microversion: 2.1 time: 0.126709 Aug 02 10:32:09.417797 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 626/1257] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:09 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 1392 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:32:09.958056 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-8d2f0b79-af6c-4060-a2e0-be8d7c74a3f0 req-ae6def6a-9c9a-474b-816d-352f46712e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c5efe2-a517-4412-9f74-c78d30243786", "name": "network-vif-deleted", "tag": "3d7c67d0-4abc-46a6-b841-3085b992a63a"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:32:09.967718 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-8d2f0b79-af6c-4060-a2e0-be8d7c74a3f0 req-ae6def6a-9c9a-474b-816d-352f46712e8f service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:09.968158 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-8d2f0b79-af6c-4060-a2e0-be8d7c74a3f0 req-ae6def6a-9c9a-474b-816d-352f46712e8f service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:09.981263 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-8d2f0b79-af6c-4060-a2e0-be8d7c74a3f0 req-ae6def6a-9c9a-474b-816d-352f46712e8f service nova] Creating event network-vif-deleted:3d7c67d0-4abc-46a6-b841-3085b992a63a for instance 28c5efe2-a517-4412-9f74-c78d30243786 on hv-cinder-84713 Aug 02 10:32:09.986037 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-8d2f0b79-af6c-4060-a2e0-be8d7c74a3f0 req-ae6def6a-9c9a-474b-816d-352f46712e8f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031671 Aug 02 10:32:09.986605 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 632/1258] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:10.438179 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:10.438916 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: 28c5efe2-a517-4412-9f74-c78d30243786] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:10.445989 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.446441 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.447331 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.447813 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.461610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] HTTP exception thrown: Instance 28c5efe2-a517-4412-9f74-c78d30243786 could not be found. Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Request method failure captured: Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 HTTP/1.1 Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PsAdGMn_Omub4-Auu34OtG-j1a7ShrwnDm0PfhJ3EYZ-8UsspGOCuuVoMw5ggQGpoDRZqiKNsJSFRPyXGEnrk3D2dCPTQ8B3Bgf0kynMZ9YofDAA09_mAhhMkZAaMJclCdbQsXlh57zVLuOTTD0h9oCwqTX5SHORbjrcwmRMzk3tks Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:32:10.463268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/06660bbc73344c53b5a0337808514df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_06660bbc73344c53b5a0337808514df7", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: e08bc25f122445f592652671790cc658 Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 28c5efe2-a517-4412-9f74-c78d30243786 could not be found. Aug 02 10:32:10.465524 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '28c5efe2-a517-4412-9f74-c78d30243786'} Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c5efe2-a517-4412-9f74-c78d30243786 could not be found. Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:32:10.466424 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c5efe2-a517-4412-9f74-c78d30243786 could not be found. Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c5efe2-a517-4412-9f74-c78d30243786 could not be found. Aug 02 10:32:10.467700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.468925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Returning 404 to user: Instance 28c5efe2-a517-4412-9f74-c78d30243786 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:32:10.468925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-030273ae-9a07-4fd6-97ab-0bcbf9d27d99 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786" status: 404 len: 111 microversion: 2.1 time: 0.030948 Aug 02 10:32:10.468925 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 627/1259] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:10 2022] GET /compute/v2.1/servers/28c5efe2-a517-4412-9f74-c78d30243786 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:32:10.944077 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:10.944588 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:10.952503 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.953253 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.954460 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.954904 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.971508 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] HTTP exception thrown: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Request method failure captured: Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: DELETE /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba HTTP/1.1 Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6PsAdGMn_Omub4-Auu34OtG-j1a7ShrwnDm0PfhJ3EYZ-8UsspGOCuuVoMw5ggQGpoDRZqiKNsJSFRPyXGEnrk3D2dCPTQ8B3Bgf0kynMZ9YofDAA09_mAhhMkZAaMJclCdbQsXlh57zVLuOTTD0h9oCwqTX5SHORbjrcwmRMzk3tks Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:32:10.973185 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/06660bbc73344c53b5a0337808514df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_06660bbc73344c53b5a0337808514df7", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: e08bc25f122445f592652671790cc658 Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:10.974785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'ca275f46-5c0d-4492-8ba8-e0b65fcc42ba'} Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:32:10.975642 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:10.977008 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:32:10.978444 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Returning 404 to user: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:32:10.978444 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-d8075b4b-f251-47a7-a285-63b0404b2028 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 404 len: 111 microversion: 2.1 time: 0.035863 Aug 02 10:32:10.978444 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 633/1260] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:32:10 2022] DELETE /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:32:10.984026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:10.984708 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] [instance: ca275f46-5c0d-4492-8ba8-e0b65fcc42ba] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:10.992829 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.993691 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:10.995140 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:10.997344 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:11.022678 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] HTTP exception thrown: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Request method failure captured: Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba HTTP/1.1 Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6PsAdGMn_Omub4-Auu34OtG-j1a7ShrwnDm0PfhJ3EYZ-8UsspGOCuuVoMw5ggQGpoDRZqiKNsJSFRPyXGEnrk3D2dCPTQ8B3Bgf0kynMZ9YofDAA09_mAhhMkZAaMJclCdbQsXlh57zVLuOTTD0h9oCwqTX5SHORbjrcwmRMzk3tks Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:32:11.025490 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/06660bbc73344c53b5a0337808514df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/06660bbc73344c53b5a0337808514df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_06660bbc73344c53b5a0337808514df7", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 06660bbc73344c53b5a0337808514df7 Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-TestVolumeBootPattern-60672759 Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: e08bc25f122445f592652671790cc658 Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-TestVolumeBootPattern-60672759-project Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:11.027635 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'ca275f46-5c0d-4492-8ba8-e0b65fcc42ba'} Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:32:11.028491 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. Aug 02 10:32:11.033963 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:32:11.035390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Returning 404 to user: Instance ca275f46-5c0d-4492-8ba8-e0b65fcc42ba could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:32:11.035390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-7d8a1321-8837-4808-9017-adc5ef10bb31 tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba" status: 404 len: 111 microversion: 2.1 time: 0.048058 Aug 02 10:32:11.035390 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 628/1261] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:32:10 2022] GET /compute/v2.1/servers/ca275f46-5c0d-4492-8ba8-e0b65fcc42ba => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:32:12.347940 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-044f8979-044d-4a7c-aca2-e9e28c23084c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] Calling method '.version_select at 0x7f5c037541f0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:12.367042 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-044f8979-044d-4a7c-aca2-e9e28c23084c tempest-TestVolumeBootPattern-60672759 tempest-TestVolumeBootPattern-60672759-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2032059013" status: 202 len: 0 microversion: 2.1 time: 0.022826 Aug 02 10:32:12.367964 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 634/1262] 10.222.0.82 () {58 vars in 1263 bytes} [Tue Aug 2 10:32:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2032059013 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:32:49.857655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:49.858169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:49.860365 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:49.861182 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG dbcounter [-] [118032] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:49.867677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:49.868057 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:49.868839 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:49.869268 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:49.894157 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-1ada8dc2-2f46-4d7f-97e8-863c663452e6 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/ips" status: 200 len: 148 microversion: 2.1 time: 0.041167 Aug 02 10:32:49.894716 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 629/1263] 10.222.0.82 () {58 vars in 1248 bytes} [Tue Aug 2 10:32:49 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:51.225911 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:51.226656 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG dbcounter [-] [118031] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:32:51.230798 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c9ed241-d3d2-44db-a7d6-fbe56e9d9a83"}} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:32:51.233068 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:51.241357 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:51.241869 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:51.242636 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:51.243078 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:51.494432 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-1c9c6ed0-454e-44de-843d-941711ade538 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "POST /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269786 Aug 02 10:32:51.495044 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 635/1264] 10.222.0.82 () {60 vars in 1323 bytes} [Tue Aug 2 10:32:51 2022] POST /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:32:59.104482 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:59.105007 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:59.111993 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:59.112443 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:59.113206 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:59.113643 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:59.193090 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.objects.instance [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lazy-loading 'services' on Instance uuid 8999e9d4-708d-45ee-9db1-9c6459c99e57 {{(pid=118032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:32:59.268097 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-ee1f3c06-6fbe-430c-88f5-abc35d850349 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments/9c9ed241-d3d2-44db-a7d6-fbe56e9d9a83" status: 202 len: 0 microversion: 2.1 time: 0.167374 Aug 02 10:32:59.268680 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 630/1265] 10.222.0.82 () {58 vars in 1416 bytes} [Tue Aug 2 10:32:59 2022] DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments/9c9ed241-d3d2-44db-a7d6-fbe56e9d9a83 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:32:59.278175 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:32:59.281255 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:32:59.288270 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:59.288734 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:59.289546 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:32:59.290020 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:32:59.320511 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-4f70e546-13d0-46bd-8443-09828e6f45b9 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 Aug 02 10:32:59.321061 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 636/1266] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:32:59 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:33:00.334043 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:00.336629 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:00.343569 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:00.344026 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:00.344822 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:00.345258 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:00.373936 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-cba28b8b-431c-461c-97a2-3c02dcd31b08 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045025 Aug 02 10:33:00.374487 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 631/1267] 10.222.0.82 () {58 vars in 1302 bytes} [Tue Aug 2 10:33:00 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:33:00.439043 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:00.439563 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:00.446234 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:00.446724 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:00.447497 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:00.447935 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:00.472614 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Going to try to terminate instance {{(pid=118031) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:33:00.548609 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-128073ce-2bbd-4a99-a761-21869be8a62c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 204 len: 0 microversion: 2.1 time: 0.113062 Aug 02 10:33:00.549315 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 637/1268] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:33:00 2022] DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:33:00.557549 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:00.558196 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:00.564172 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:00.564626 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:00.565658 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:00.566147 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:00.698247 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:33:00.706224 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-600763dd-9fbd-4041-8af0-1ee17c955b7e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1681 microversion: 2.1 time: 0.152457 Aug 02 10:33:00.706785 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 632/1269] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:00 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:33:01.728509 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:01.729218 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:01.736307 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:01.736754 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:01.737504 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:01.737969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:01.870488 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.policy [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118031) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:33:01.877968 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-a63e38d7-9357-4865-99f2-4cacee3ffb73 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1681 microversion: 2.1 time: 0.153666 Aug 02 10:33:01.878541 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 638/1270] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:01 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:33:02.900476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:02.901618 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:02.909104 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:02.909552 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:02.910358 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:02.910799 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:03.297841 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.policy [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8774306d95c0476b80cc8e53b62e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9389c81a2710466ea8be45d2fe2342ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118032) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:33:03.306069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f04b493c-e4cd-4081-9922-4adafe6b6d6c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 200 len: 1681 microversion: 2.1 time: 0.409851 Aug 02 10:33:03.306621 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 633/1271] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:02 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:33:03.636802 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [req-0863a2d3-7e07-4045-b54b-7142caccb021 req-2a6feab1-5ed9-43f7-9991-4b06ad4d788c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8999e9d4-708d-45ee-9db1-9c6459c99e57", "name": "network-vif-deleted", "tag": "9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78"}]} {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:33:03.649485 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-0863a2d3-7e07-4045-b54b-7142caccb021 req-2a6feab1-5ed9-43f7-9991-4b06ad4d788c service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:03.650240 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [req-0863a2d3-7e07-4045-b54b-7142caccb021 req-2a6feab1-5ed9-43f7-9991-4b06ad4d788c service nova] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:03.666714 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.compute.server_external_events [req-0863a2d3-7e07-4045-b54b-7142caccb021 req-2a6feab1-5ed9-43f7-9991-4b06ad4d788c service nova] Creating event network-vif-deleted:9bf8347e-bd22-46ef-99a7-fe7f3b2f5e78 for instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 on hv-cinder-84713 Aug 02 10:33:03.678933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [req-0863a2d3-7e07-4045-b54b-7142caccb021 req-2a6feab1-5ed9-43f7-9991-4b06ad4d788c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046235 Aug 02 10:33:03.679845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 639/1272] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Aug 2 10:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:33:04.328579 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:04.329193 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:04.335778 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:04.336228 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:04.337079 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:04.337508 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:04.355270 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 HTTP/1.1 Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:33:04.359132 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:04.361015 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '8999e9d4-708d-45ee-9db1-9c6459c99e57'} Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:04.362163 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:04.364404 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:04.365999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:04.365999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-bf000093-a42b-484e-bd1d-48e139d2cb7d tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 404 len: 111 microversion: 2.1 time: 0.036758 Aug 02 10:33:04.365999 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 634/1273] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:04 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:04.374785 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-82b8d0fa-2f8c-4de9-b558-faf8cfca04c5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '.version_select at 0x7f5c037548b0>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:04.394262 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-82b8d0fa-2f8c-4de9-b558-faf8cfca04c5 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608081653" status: 202 len: 0 microversion: 2.1 time: 0.024650 Aug 02 10:33:04.394845 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 640/1274] 10.222.0.82 () {58 vars in 1221 bytes} [Tue Aug 2 10:33:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608081653 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:33:06.152478 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:06.152982 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:06.159630 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:06.160082 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:06.160847 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:06.161312 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:06.176573 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 HTTP/1.1 Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:33:06.178142 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.179930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '8999e9d4-708d-45ee-9db1-9c6459c99e57'} Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:06.181725 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.183074 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.184623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:06.184623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-6bc2d98c-2631-45d2-9254-2f075f5ad1f0 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 404 len: 111 microversion: 2.1 time: 0.030945 Aug 02 10:33:06.184623 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 635/1275] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:33:06 2022] DELETE /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:06.188634 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:06.189363 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 8999e9d4-708d-45ee-9db1-9c6459c99e57] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:06.196109 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:06.196554 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:06.197308 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:06.197737 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:06.210502 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 HTTP/1.1 Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:33:06.212098 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.213821 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '8999e9d4-708d-45ee-9db1-9c6459c99e57'} Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:06.214837 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. Aug 02 10:33:06.216423 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:06.218146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance 8999e9d4-708d-45ee-9db1-9c6459c99e57 could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:06.218146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-e8869185-3a27-487d-9f65-f54ce7a19bfc tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57" status: 404 len: 111 microversion: 2.1 time: 0.029208 Aug 02 10:33:06.218146 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 641/1276] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:06 2022] GET /compute/v2.1/servers/8999e9d4-708d-45ee-9db1-9c6459c99e57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:07.349035 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:07.349543 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:07.356058 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.356509 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.357891 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.358335 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.371655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b HTTP/1.1 Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:33:07.373235 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.374818 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'e64d6553-8f47-403a-a644-70887989602b'} Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:07.375663 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.376958 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.378551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:07.378551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-f1c275f2-a570-457f-969f-25f2400db25e tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 404 len: 111 microversion: 2.1 time: 0.029454 Aug 02 10:33:07.378551 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 636/1277] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:33:07 2022] DELETE /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:07.383366 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:07.383979 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e64d6553-8f47-403a-a644-70887989602b] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:07.390405 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.390853 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.391625 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.392059 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.405716 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b HTTP/1.1 Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:33:07.407249 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.408917 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'e64d6553-8f47-403a-a644-70887989602b'} Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:07.409883 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. Aug 02 10:33:07.411229 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.413334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance e64d6553-8f47-403a-a644-70887989602b could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:07.413334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-823a1819-2a7c-4266-9307-4bb93b8a34f7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b" status: 404 len: 111 microversion: 2.1 time: 0.029172 Aug 02 10:33:07.413334 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 642/1278] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:07 2022] GET /compute/v2.1/servers/e64d6553-8f47-403a-a644-70887989602b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:07.416997 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:07.417493 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:07.424072 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.424522 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.425287 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.425723 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.438907 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d HTTP/1.1 Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:33:07.440677 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.442407 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': '7fc26b90-7065-470e-b612-ceef2e8f497d'} Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:07.443445 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.445087 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.447003 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:07.447003 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-b2a21a1d-243a-44ed-a6c6-883c88de4a07 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 404 len: 111 microversion: 2.1 time: 0.028824 Aug 02 10:33:07.447003 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 637/1279] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:33:07 2022] DELETE /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:07.450169 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:07.451309 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: 7fc26b90-7065-470e-b612-ceef2e8f497d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:07.457487 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.457969 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.458725 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:07.459157 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:07.472742 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d HTTP/1.1 Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:33:07.474274 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.475983 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': '7fc26b90-7065-470e-b612-ceef2e8f497d'} Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:07.477062 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. Aug 02 10:33:07.478659 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:07.480009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance 7fc26b90-7065-470e-b612-ceef2e8f497d could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:07.480009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-7b7c090a-fec3-4cff-b3ac-b08ba1aef1ca tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d" status: 404 len: 111 microversion: 2.1 time: 0.029189 Aug 02 10:33:07.480009 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 643/1280] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:07 2022] GET /compute/v2.1/servers/7fc26b90-7065-470e-b612-ceef2e8f497d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:08.612288 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:08.612810 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.compute.api [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118032) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:08.619169 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:08.619613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:08.620367 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:08.620795 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG oslo_concurrency.lockutils [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:08.635613 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.wsgi [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: request: DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d HTTP/1.1 Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept: application/json Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Accept-Encoding: identity Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Connection: close Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Length: 0 Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Content-Type: application/json Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Host: 10.222.0.82 Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Openstack-System-Scope: None Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Id: None Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Domain-Name: None Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Identity-Status: Confirmed Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Is-Admin-Project: True Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Id: default Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Domain-Name: Default Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Role: reader,member Aug 02 10:33:08.637136 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Roles: reader,member Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Id: default Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Domain-Name: Default Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: method: > Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: exception: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.638828 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: action_args: {'id': 'e023bb92-5fed-496c-a500-1d424eb6621d'} Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: {{(pid=118032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:08.639930 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.641476 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.643133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: DEBUG nova.api.openstack.wsgi [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. {{(pid=118032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:08.643133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO nova.api.openstack.requestlog [None req-2cae6794-e1c4-4814-b13b-7c66d24e1cb7 tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 404 len: 111 microversion: 2.1 time: 0.030021 Aug 02 10:33:08.643133 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: [pid: 118032|app: 0|req: 638/1281] 10.222.0.82 () {58 vars in 1239 bytes} [Tue Aug 2 10:33:08 2022] DELETE /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:33:08.646933 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Calling method '>' {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:33:08.647556 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.compute.api [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] [instance: e023bb92-5fed-496c-a500-1d424eb6621d] Fetching instance by UUID {{(pid=118031) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:33:08.653702 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:08.654766 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:08.655532 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:33:08.655970 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG oslo_concurrency.lockutils [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Lock "df30d8db-5664-49ef-9995-24fa3fa4271f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:33:08.669028 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.wsgi [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] HTTP exception thrown: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Request method failure captured: Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: request: GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d HTTP/1.1 Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept: application/json Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Accept-Encoding: identity Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Connection: close Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Length: 0 Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Content-Type: application/json Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Host: 10.222.0.82 Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Openstack-System-Scope: None Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: User-Agent: python-urllib3/1.26.10 Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Auth-Token: gAAAAABi6Ps1t81C7DTLGcPULjV8wS787BbizFWlvyZEQ-VqhrLWeJBSu-h2NpRKnd5DTj1OsH0xeirynajhl_zCgg4cHqJUkNZs2EirTWEjGxqkj0Ultj2fol0SADiCm2A8M7y8B0Fw7oa1e5THcfkpZ17Yq9oVcvciBGqseZTjl-uCcEdl8RA Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Id: None Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Domain-Name: None Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Identity-Status: Confirmed Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Is-Admin-Project: True Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Id: default Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Domain-Name: Default Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Role: reader,member Aug 02 10:33:08.671210 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Roles: reader,member Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9389c81a2710466ea8be45d2fe2342ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9389c81a2710466ea8be45d2fe2342ef", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Id: 9389c81a2710466ea8be45d2fe2342ef Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057617004 Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Id: default Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Domain-Name: Default Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Id: 8774306d95c0476b80cc8e53b62e8a4b Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: X-User-Name: tempest-AttachVolumeNegativeTest-2057617004-project Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: method: > Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: exception: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.672909 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: action_args: {'id': 'e023bb92-5fed-496c-a500-1d424eb6621d'} Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: {{(pid=118031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:33:08.674108 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. Aug 02 10:33:08.675661 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: ERROR nova.api.openstack.wsgi Aug 02 10:33:08.677248 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: DEBUG nova.api.openstack.wsgi [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] Returning 404 to user: Instance e023bb92-5fed-496c-a500-1d424eb6621d could not be found. {{(pid=118031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:33:08.677248 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO nova.api.openstack.requestlog [None req-507b5723-6c51-44d1-bb9d-2959d71ec57c tempest-AttachVolumeNegativeTest-2057617004 tempest-AttachVolumeNegativeTest-2057617004-project] 10.222.0.82 "GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d" status: 404 len: 111 microversion: 2.1 time: 0.029438 Aug 02 10:33:08.677248 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: [pid: 118031|app: 0|req: 644/1282] 10.222.0.82 () {58 vars in 1236 bytes} [Tue Aug 2 10:33:08 2022] GET /compute/v2.1/servers/e023bb92-5fed-496c-a500-1d424eb6621d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:34:34.275921 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:34:34.276610 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Tue Aug 2 10:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:34:49.854606 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:34:49.855140 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:36:13.590429 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:36:13.591169 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:36:21.543449 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:36:21.544063 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Tue Aug 2 10:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:37:54.284655 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:37:54.285389 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Tue Aug 2 10:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:38:09.862820 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:09.863285 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:38:26.611898 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:26.612575 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:38:29.132606 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:38:29.133170 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Tue Aug 2 10:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:39:33.598591 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:39:33.599246 dv-cinder-847132-4-iscsi devstack@n-api.service[118031]: Tue Aug 2 10:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:39:41.552069 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:39:41.552700 dv-cinder-847132-4-iscsi devstack@n-api.service[118032]: Tue Aug 2 10:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!